Jul 29 22:44:13.947136 ip-10-0-139-98 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 22:44:13.947144 ip-10-0-139-98 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 22:44:13.947153 ip-10-0-139-98 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 22:44:13.947597 ip-10-0-139-98 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 22:44:22.719758 ip-10-0-139-98 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 22:44:22.719770 ip-10-0-139-98 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ab9aea260afc4f61bd5dd744e4a63130 -- Jul 29 22:45:49.401387 ip-10-0-139-98 systemd[1]: Starting Kubernetes Kubelet... Jul 29 22:45:49.773205 ip-10-0-139-98 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:45:49.773205 ip-10-0-139-98 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 22:45:49.773205 ip-10-0-139-98 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:45:49.773205 ip-10-0-139-98 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 22:45:49.773205 ip-10-0-139-98 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:45:49.775224 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.775140 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 22:45:49.780507 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780491 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:45:49.780507 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780507 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780512 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780515 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780519 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780521 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780524 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780527 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780530 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780533 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780536 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780538 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780541 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780544 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780554 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780556 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780559 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780562 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780565 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780568 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:45:49.780574 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780571 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780574 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780576 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780579 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780582 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780585 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780588 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780591 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780593 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780596 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780598 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780601 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780604 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780606 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780608 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780611 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780613 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780616 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780618 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780621 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:45:49.781065 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780623 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780626 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780628 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780631 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780633 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780635 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780638 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780641 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780643 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780646 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780649 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780651 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780654 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780656 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780660 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780663 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780666 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780668 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780671 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780674 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:45:49.781580 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780677 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780680 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780683 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780686 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780688 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780691 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780693 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780696 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780699 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780701 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780705 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780707 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780710 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780712 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780715 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780717 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780720 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780722 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780725 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780728 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:45:49.782071 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780730 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780735 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780739 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780741 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780744 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780747 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780750 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780754 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780757 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780761 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780765 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780768 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780772 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780774 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780777 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780780 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780783 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780786 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:45:49.782578 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.780790 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:45:49.783579 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783567 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:45:49.783579 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783579 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783583 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783587 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783590 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783593 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783596 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783599 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783602 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783605 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783607 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783610 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783613 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783616 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783618 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783621 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783623 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783626 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783629 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783632 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783634 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:45:49.783641 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783637 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783640 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783643 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783646 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783648 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783652 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783656 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783658 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783661 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783664 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783668 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783672 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783675 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783678 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783681 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783684 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783688 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783690 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783693 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:45:49.784141 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783696 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783698 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783701 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783703 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783706 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783708 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783711 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783713 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783716 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783718 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783721 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783723 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783725 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783728 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783730 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783734 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783737 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783739 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783742 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:45:49.784603 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783744 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783747 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783750 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783753 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783756 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783758 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783761 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783764 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783766 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783769 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783771 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783774 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783777 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783779 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783782 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783784 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783787 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783789 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783792 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783794 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:45:49.785092 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783797 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783800 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783802 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783806 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783808 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783811 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783814 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783816 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783820 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783823 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783827 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783830 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783833 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783836 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783839 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783842 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783845 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783847 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783850 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:45:49.785758 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.783852 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784225 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784230 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784233 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784236 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784239 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784242 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784244 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784247 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784249 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784252 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784255 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784257 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784260 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784263 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784268 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784272 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784275 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784277 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784280 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:45:49.786455 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784283 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784287 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784290 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784293 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784295 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784298 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784301 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784303 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784306 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784308 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784311 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784313 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784316 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784318 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784321 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784323 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784327 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784331 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784334 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:45:49.787061 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784337 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784339 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784342 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784346 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784349 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784351 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784354 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784357 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784360 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784362 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784365 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784367 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784370 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784372 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784375 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784378 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784380 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784383 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784386 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:45:49.787606 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784388 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784391 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784393 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784396 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784399 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784401 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784403 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784406 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784408 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784412 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784415 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784417 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784421 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784423 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784426 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784428 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784431 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784434 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784439 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784442 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:45:49.788081 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784444 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784447 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784450 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784452 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784455 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784458 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784461 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784464 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784467 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784469 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784472 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784475 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784478 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784480 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784483 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784485 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784488 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784491 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784494 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784496 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:45:49.788610 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784499 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.784501 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784574 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784591 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784601 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784609 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784614 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784617 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784622 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784626 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784631 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784634 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784638 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784641 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784644 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784648 2569 flags.go:64] FLAG: --cgroup-root="" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784650 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784654 2569 flags.go:64] FLAG: --client-ca-file="" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784656 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784659 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784664 2569 flags.go:64] FLAG: --cluster-domain="" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784667 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784670 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784673 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 22:45:49.789123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784676 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784680 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784683 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784686 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784689 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784692 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784695 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784698 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784700 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784704 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784709 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784712 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784714 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784717 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784721 2569 flags.go:64] FLAG: --enable-server="true" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784724 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784729 2569 flags.go:64] FLAG: --event-burst="100" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784732 2569 flags.go:64] FLAG: --event-qps="50" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784737 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784740 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784743 2569 flags.go:64] FLAG: --eviction-hard="" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784746 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784749 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784752 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784755 2569 flags.go:64] FLAG: --eviction-soft="" Jul 29 22:45:49.789736 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784758 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784761 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784764 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784767 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784770 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784773 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784776 2569 flags.go:64] FLAG: --feature-gates="" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784780 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784783 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784786 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784789 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784792 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784795 2569 flags.go:64] FLAG: --help="false" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784797 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-139-98.ec2.internal" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784801 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784803 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784806 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784809 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784813 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784816 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784818 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784821 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784824 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 22:45:49.790401 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784827 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784830 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784835 2569 flags.go:64] FLAG: --kube-reserved="" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784838 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784840 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784844 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784846 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784849 2569 flags.go:64] FLAG: --lock-file="" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784852 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784854 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784857 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784863 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784866 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784869 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784872 2569 flags.go:64] FLAG: --logging-format="text" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784874 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784878 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784881 2569 flags.go:64] FLAG: --manifest-url="" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784884 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784888 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784891 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784894 2569 flags.go:64] FLAG: --max-pods="110" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784897 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784900 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784903 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 22:45:49.790985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784906 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784909 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784912 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784916 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784922 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784925 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784929 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784932 2569 flags.go:64] FLAG: --pod-cidr="" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784935 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784942 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784945 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784949 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784952 2569 flags.go:64] FLAG: --port="10250" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784955 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784958 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0df496fbf0652fe37" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784961 2569 flags.go:64] FLAG: --qos-reserved="" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784964 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784967 2569 flags.go:64] FLAG: --register-node="true" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784970 2569 flags.go:64] FLAG: --register-with-taints="" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784974 2569 flags.go:64] FLAG: --registry-burst="10" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784977 2569 flags.go:64] FLAG: --registry-qps="5" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784979 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784982 2569 flags.go:64] FLAG: --reserved-memory="" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784986 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784989 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 22:45:49.791645 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784992 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784995 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.784997 2569 flags.go:64] FLAG: --runonce="false" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785000 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785003 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785006 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785009 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785012 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785014 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785017 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785020 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785023 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785026 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785029 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785031 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785035 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785039 2569 flags.go:64] FLAG: --system-cgroups="" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785042 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785047 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785050 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785053 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785057 2569 flags.go:64] FLAG: --tls-min-version="" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785059 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785062 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785065 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 22:45:49.792456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785068 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785071 2569 flags.go:64] FLAG: --v="2" Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785075 2569 flags.go:64] FLAG: --version="false" Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785079 2569 flags.go:64] FLAG: --vmodule="" Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785082 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.785085 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785669 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785682 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785687 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785691 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785697 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785701 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785706 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785711 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785722 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785726 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785730 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785734 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785739 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785744 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785748 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:45:49.793070 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785752 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785756 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785763 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785768 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785772 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785777 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785786 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785790 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785795 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785799 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785803 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785807 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785814 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785818 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785822 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785826 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785830 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785835 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785843 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:45:49.793609 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785848 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785852 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785858 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785864 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785869 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785874 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785878 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785883 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785887 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785893 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785899 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785908 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785913 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785917 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785922 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785928 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785933 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785938 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785943 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:45:49.794077 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785947 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785952 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785956 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785960 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785964 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785972 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785978 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785983 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785987 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785991 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785995 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.785999 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786003 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786007 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786012 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786017 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786021 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786025 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786034 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786039 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:45:49.794632 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786043 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786047 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786052 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786056 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786060 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786065 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786069 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786073 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786077 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786081 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786093 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786097 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786116 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786121 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786125 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786129 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786133 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786138 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786144 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:45:49.795131 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786148 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786154 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786159 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786165 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786196 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786219 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.786235 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.787010 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.793424 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.793441 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.794135 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.794145 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794204 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794209 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:45:49.795596 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794212 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794216 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794219 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794222 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794225 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794228 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794231 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794233 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794236 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794240 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794244 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794248 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794251 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794255 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794260 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794264 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794267 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794271 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794274 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:45:49.795952 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794276 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794279 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794282 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794284 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794287 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794290 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794292 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794295 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794299 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794302 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794305 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794307 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794311 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794313 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794316 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794319 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794321 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794324 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794326 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794329 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:45:49.796435 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794332 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794334 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794337 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794340 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794343 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794345 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794348 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794351 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794353 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794356 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794359 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794361 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794364 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794367 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794369 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794372 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794375 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794377 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794380 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794383 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:45:49.796921 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794386 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794388 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794391 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794394 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794396 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794399 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794402 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794404 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794407 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794410 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794412 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794415 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794417 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794420 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794423 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794426 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794428 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794431 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794433 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794436 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:45:49.797489 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794439 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794441 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794443 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794446 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794448 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794452 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794454 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794456 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794459 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794461 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794464 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794468 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794470 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794473 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794476 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794479 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794481 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:45:49.797974 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794484 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.794489 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794622 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794627 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794631 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794634 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794637 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794640 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794643 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794645 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794648 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794651 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794653 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794656 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794658 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:45:49.798396 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794661 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794664 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794666 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794669 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794672 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794674 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794677 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794679 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794682 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794685 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794687 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794690 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794693 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794696 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794699 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794701 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794704 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794706 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794709 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794711 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:45:49.798784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794714 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794716 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794719 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794722 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794724 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794727 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794729 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794732 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794734 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794737 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794741 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794743 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794746 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794748 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794750 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794753 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794756 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794758 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794761 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:45:49.799290 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794763 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794767 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794771 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794774 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794778 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794781 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794784 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794787 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794790 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794793 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794795 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794797 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794800 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794803 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794805 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794808 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794810 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794813 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794815 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:45:49.799784 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794818 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794820 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794823 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794825 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794827 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794831 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794834 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794837 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794841 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794844 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794847 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794850 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794853 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794855 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794858 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794861 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794864 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794867 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794869 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794872 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:45:49.800262 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794875 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794878 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794881 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794883 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794886 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794888 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794891 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:49.794893 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.794898 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.795006 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.797145 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.798483 2569 server.go:1019] "Starting client certificate rotation" Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.798578 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 22:45:49.800749 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.798608 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 22:45:49.801465 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.801451 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 22:45:49.802722 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.802708 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 22:45:49.816752 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.816728 2569 log.go:25] "Validated CRI v1 runtime API" Jul 29 22:45:49.819569 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.819555 2569 log.go:25] "Validated CRI v1 image API" Jul 29 22:45:49.821233 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.821211 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 22:45:49.823789 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.823749 2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ce5082cf-fb43-4def-af76-adaff5f0e8db:/dev/nvme0n1p3 ef006e7d-4f51-4c58-8d19-d10bdfb042fa:/dev/nvme0n1p4] Jul 29 22:45:49.823873 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.823788 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 22:45:49.827819 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.827796 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 22:45:49.829062 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.828946 2569 manager.go:216] Machine: {Timestamp:2026-07-29 22:45:49.828476998 +0000 UTC m=+0.319243473 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3133291 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec270b7887cc134316615d1dc6012256 SystemUUID:ec270b78-87cc-1343-1661-5d1dc6012256 BootID:ab9aea26-0afc-4f61-bd5d-d744e4a63130 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:3c:45:08:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:3c:45:08:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:ed:fd:93:99:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 22:45:49.829062 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.829053 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 22:45:49.829238 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.829178 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 22:45:49.832522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.832498 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 22:45:49.832659 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.832525 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 22:45:49.833246 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.833236 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 22:45:49.833283 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.833248 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 22:45:49.833283 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.833255 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 22:45:49.833761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.833751 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 22:45:49.834557 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.834548 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 22:45:49.837232 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837220 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 29 22:45:49.837346 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837337 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 22:45:49.837384 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837367 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 29 22:45:49.837384 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837376 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 22:45:49.837434 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837394 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 22:45:49.837434 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837404 2569 kubelet.go:398] "Adding apiserver pod source" Jul 29 22:45:49.837434 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837412 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 22:45:49.837798 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837786 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 22:45:49.837843 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.837803 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 22:45:49.839934 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.839920 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 22:45:49.842117 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.842090 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 22:45:49.842166 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.842135 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 22:45:49.844231 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844219 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 22:45:49.844277 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844236 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 22:45:49.844277 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844243 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 22:45:49.844277 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844248 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 22:45:49.844277 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844257 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 22:45:49.844277 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844262 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 22:45:49.844277 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844275 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 22:45:49.844433 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844283 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 22:45:49.844433 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844289 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 22:45:49.844433 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844295 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 22:45:49.844433 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844310 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 22:45:49.844433 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844315 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 22:45:49.844981 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844973 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 22:45:49.845012 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.844986 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 22:45:49.848056 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.848039 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 22:45:49.848150 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.848123 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 22:45:49.848185 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.848128 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 22:45:49.848615 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.848604 2569 server.go:1268] "Started kubelet" Jul 29 22:45:49.848734 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.848709 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 22:45:49.848811 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.848709 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 22:45:49.848811 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.848780 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 22:45:49.849514 ip-10-0-139-98 systemd[1]: Started Kubernetes Kubelet. Jul 29 22:45:49.850496 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.850483 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 29 22:45:49.852283 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.851480 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 22:45:49.852973 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.852953 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 22:45:49.857378 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.857362 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 22:45:49.857520 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.857502 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 22:45:49.857619 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.857504 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:49.858066 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.858053 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 22:45:49.860276 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.860179 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 22:45:49.860370 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.860283 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 22:45:49.860427 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.857419 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e424ff13bdf9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.848419833 +0000 UTC m=+0.339186309,LastTimestamp:2026-07-29 22:45:49.848419833 +0000 UTC m=+0.339186309,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.860494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.860426 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 29 22:45:49.860494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.860435 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 29 22:45:49.862452 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862412 2569 factory.go:55] Registering systemd factory Jul 29 22:45:49.862452 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862433 2569 factory.go:223] Registration of the systemd container factory successfully Jul 29 22:45:49.862687 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862661 2569 factory.go:153] Registering CRI-O factory Jul 29 22:45:49.862687 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862680 2569 factory.go:223] Registration of the crio container factory successfully Jul 29 22:45:49.862796 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862735 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 22:45:49.862796 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862759 2569 factory.go:103] Registering Raw factory Jul 29 22:45:49.862796 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.862776 2569 manager.go:1196] Started watching for new ooms in manager Jul 29 22:45:49.863279 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.863257 2569 manager.go:349] Starting recovery of all containers Jul 29 22:45:49.864097 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.864068 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 22:45:49.864097 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.864080 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 22:45:49.874316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.874303 2569 manager.go:354] Recovery completed Jul 29 22:45:49.879366 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.879249 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:49.881054 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881026 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:49.881149 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881070 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:49.881149 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881082 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:49.881668 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881651 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 22:45:49.881668 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881668 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 22:45:49.881769 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881692 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 29 22:45:49.881769 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.881698 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:49.882414 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.882398 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:49.882473 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.882426 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:49.882473 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.882440 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:49.883517 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.883437 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e4250105b168 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.881053544 +0000 UTC m=+0.371820029,LastTimestamp:2026-07-29 22:45:49.881053544 +0000 UTC m=+0.371820029,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.884400 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.884387 2569 policy_none.go:49] "None policy: Start" Jul 29 22:45:49.884450 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.884404 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 22:45:49.884450 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.884415 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 22:45:49.886410 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.886398 2569 policy_none.go:47] "Start" Jul 29 22:45:49.894837 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.894691 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e4250106088d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.881075853 +0000 UTC m=+0.371842330,LastTimestamp:2026-07-29 22:45:49.881075853 +0000 UTC m=+0.371842330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.902748 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.902666 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e425010632bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.881086652 +0000 UTC m=+0.371853128,LastTimestamp:2026-07-29 22:45:49.881086652 +0000 UTC m=+0.371853128,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.912212 2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-98.ec2.internal.18c6e4250105b168\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e4250105b168 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.881053544 +0000 UTC m=+0.371820029,LastTimestamp:2026-07-29 22:45:49.882413323 +0000 UTC m=+0.373179799,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.917289 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.917817 2569 manager.go:337] "Starting Device Plugin manager" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.917851 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.917865 2569 server.go:87] "Starting device plugin registration server" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918160 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918174 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918441 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918522 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918531 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918888 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918922 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.918943 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.918975 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.919029 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.918982 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.919804 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5x95" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.924760 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.924853 2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-98.ec2.internal.18c6e4250106088d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e4250106088d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.881075853 +0000 UTC m=+0.371842330,LastTimestamp:2026-07-29 22:45:49.882433086 +0000 UTC m=+0.373199569,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.929021 2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-98.ec2.internal.18c6e425010632bc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e425010632bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.881086652 +0000 UTC m=+0.371853128,LastTimestamp:2026-07-29 22:45:49.882445146 +0000 UTC m=+0.373211623,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:49.932420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:49.929165 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5x95" Jul 29 22:45:49.935545 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:49.935492 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18c6e42503774a87 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-07-29 22:45:49.922052743 +0000 UTC m=+0.412819217,LastTimestamp:2026-07-29 22:45:49.922052743 +0000 UTC m=+0.412819217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}" Jul 29 22:45:50.019066 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.019034 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:50.019746 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.019700 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"] Jul 29 22:45:50.019807 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.019789 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:50.020314 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020291 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:50.020420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020331 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:50.020420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020346 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:50.020420 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020374 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.020713 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020695 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:50.020762 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020727 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:50.020762 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.020740 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:50.022947 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.022936 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:50.023063 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.023114 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023078 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:50.023684 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023639 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:50.023684 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023672 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:50.023684 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023683 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:50.023798 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023643 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:50.023798 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023742 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:50.023798 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.023753 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:50.025987 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.025972 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.026061 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.025994 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:45:50.026637 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.026625 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:45:50.026705 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.026650 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:45:50.026705 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.026662 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:45:50.028739 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.028717 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.028834 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.028743 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-98.ec2.internal\": node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.056292 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.056258 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.063966 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.063945 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-98.ec2.internal\" not found" node="ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.068578 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.068562 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-98.ec2.internal\" not found" node="ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.157114 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.157087 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.161375 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.161355 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117d5dfc69795e65811eb7e229dc6f0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"117d5dfc69795e65811eb7e229dc6f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.161446 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.161384 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117d5dfc69795e65811eb7e229dc6f0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"117d5dfc69795e65811eb7e229dc6f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.161446 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.161400 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89d65a12d350978c7bc79752021005ef-config\") pod \"kube-apiserver-proxy-ip-10-0-139-98.ec2.internal\" (UID: \"89d65a12d350978c7bc79752021005ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.258207 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.258168 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.262408 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.262394 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117d5dfc69795e65811eb7e229dc6f0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"117d5dfc69795e65811eb7e229dc6f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.262459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.262415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117d5dfc69795e65811eb7e229dc6f0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"117d5dfc69795e65811eb7e229dc6f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.262459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.262446 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89d65a12d350978c7bc79752021005ef-config\") pod \"kube-apiserver-proxy-ip-10-0-139-98.ec2.internal\" (UID: \"89d65a12d350978c7bc79752021005ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.262548 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.262484 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89d65a12d350978c7bc79752021005ef-config\") pod \"kube-apiserver-proxy-ip-10-0-139-98.ec2.internal\" (UID: \"89d65a12d350978c7bc79752021005ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.262548 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.262516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117d5dfc69795e65811eb7e229dc6f0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"117d5dfc69795e65811eb7e229dc6f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.262625 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.262514 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117d5dfc69795e65811eb7e229dc6f0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"117d5dfc69795e65811eb7e229dc6f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.358933 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.358857 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.366314 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.366292 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.371157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.371139 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.459197 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.459156 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.559725 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.559693 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.660313 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.660233 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.760874 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.760842 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found" Jul 29 22:45:50.763274 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.763257 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:45:50.798550 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.798515 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 22:45:50.838575 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.838546 2569 apiserver.go:52] "Watching apiserver" Jul 29 22:45:50.847814 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.847624 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 22:45:50.848064 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.848041 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t2fvl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc","openshift-cluster-node-tuning-operator/tuned-kg86g","openshift-multus/multus-hm8q4","openshift-network-operator/iptables-alerter-x7zgx","openshift-ovn-kubernetes/ovnkube-node-6tjnc","kube-system/konnectivity-agent-t9pnv","openshift-dns/node-resolver-dm4l8","openshift-image-registry/node-ca-9wvgb","openshift-multus/multus-additional-cni-plugins-gnwtp","openshift-multus/network-metrics-daemon-wrq56","openshift-network-diagnostics/network-check-target-lxq2f"] Jul 29 22:45:50.850640 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.850612 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.850729 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.850701 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:45:50.852688 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.852670 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.854846 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.854826 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.855055 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.855036 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.855159 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.855064 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b9jnh\"" Jul 29 22:45:50.855159 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.855124 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.855274 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.855165 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 22:45:50.857944 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.857529 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.857944 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.857785 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 22:45:50.857944 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.857816 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.857944 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.857862 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.858188 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.858005 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ncpf7\"" Jul 29 22:45:50.858778 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.858756 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.860522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.859899 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbwgh\"" Jul 29 22:45:50.860522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.860062 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 22:45:50.860522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.860190 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.860522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.860320 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.860522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.860462 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.860815 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.860801 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 22:45:50.862513 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.862492 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.862690 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.862522 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 22:45:50.862787 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.862772 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.863026 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.863008 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5bd6\"" Jul 29 22:45:50.863116 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.863059 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865175 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-node-log\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865281 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e7fdac-01c6-42c3-afc7-9d99e7776404-cni-binary-copy\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865281 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865249 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 22:45:50.865281 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865263 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-systemd\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/191bd427-74bb-4fa7-bffc-5e78e319024f-ovn-node-metrics-cert\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865309 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-log-socket\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865254 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbklw\"" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-cni-bin\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865340 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865354 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865377 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-systemd\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-run\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-multus-certs\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865449 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865449 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865464 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a69b0251-0d36-46cc-995a-898b931b4c7a-host-slash\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865503 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865540 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-var-lib-kubelet\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865570 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865583 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-cnibin\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-netns\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-cni-multus\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865644 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-ovnkube-script-lib\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865658 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/565ea92c-5654-4024-b67d-9e40473eb5d3-kubelet-config\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865672 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7rh\" (UniqueName: \"kubernetes.io/projected/61e7fdac-01c6-42c3-afc7-9d99e7776404-kube-api-access-hz7rh\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a69b0251-0d36-46cc-995a-898b931b4c7a-iptables-alerter-script\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-system-cni-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-cni-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-cni-netd\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865787 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865819 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-socket-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.865834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-device-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865854 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-conf-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mwd\" (UniqueName: \"kubernetes.io/projected/a69b0251-0d36-46cc-995a-898b931b4c7a-kube-api-access-z6mwd\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-kubelet\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-var-lib-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865929 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-etc-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-registration-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-modprobe-d\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysctl-d\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865984 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-sys\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.865997 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-slash\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866013 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-sys-fs\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866027 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-tuned\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-daemon-config\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866077 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866092 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-env-overrides\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.866549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866180 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h57c9\" (UniqueName: \"kubernetes.io/projected/47025aee-d69e-40c9-bf58-30b3fd47adfb-kube-api-access-h57c9\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866212 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-tmp\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866225 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-socket-dir-parent\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysconfig\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866253 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866258 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysctl-conf\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-lib-modules\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866303 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866314 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-etc-kubernetes\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-kubernetes\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866351 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-os-release\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-cni-bin\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866402 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-ovnkube-config\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-hostroot\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866442 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-ovn\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866457 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtvqr\" (UniqueName: \"kubernetes.io/projected/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-kube-api-access-dtvqr\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-k8s-cni-cncf-io\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866513 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866536 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vngt7\" (UniqueName: \"kubernetes.io/projected/191bd427-74bb-4fa7-bffc-5e78e319024f-kube-api-access-vngt7\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-host\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866597 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-kubelet\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-systemd-units\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866650 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-run-netns\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.866683 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/565ea92c-5654-4024-b67d-9e40473eb5d3-dbus\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.867588 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.867630 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b7tsw\"" Jul 29 22:45:50.867660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.867660 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 22:45:50.868023 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.867737 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:50.869733 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.869717 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.869840 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.869826 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.869929 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.869916 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-92zsg\"" Jul 29 22:45:50.870254 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.870238 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:50.872493 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.872473 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 22:45:50.872493 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.872477 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 22:45:50.872637 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.872506 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nk68m\"" Jul 29 22:45:50.872637 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.872578 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 22:45:50.872995 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.872979 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.875231 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.875215 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 22:45:50.875591 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.875567 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 22:45:50.875591 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.875578 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tvz2d\"" Jul 29 22:45:50.875721 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.875657 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:50.875767 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.875737 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:45:50.877201 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.877181 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 22:45:50.877849 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.877832 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:50.877908 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.877881 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:45:50.879100 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.879078 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 22:45:50.879173 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.879163 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" Jul 29 22:45:50.879252 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.879235 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"] Jul 29 22:45:50.885903 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.885886 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"] Jul 29 22:45:50.886262 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.886245 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 22:45:50.914145 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.914125 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nf8gb" Jul 29 22:45:50.928537 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.928514 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nf8gb" Jul 29 22:45:50.934206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.934163 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 22:40:50 +0000 UTC" deadline="2027-12-29 04:29:25.635927425 +0000 UTC" Jul 29 22:45:50.934323 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.934205 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12413h43m34.701726969s" Jul 29 22:45:50.949505 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:50.949477 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117d5dfc69795e65811eb7e229dc6f0e.slice/crio-27f293ec42eef2c26e03e1cccb2d06d050a8a5f7d210c09c42a88de1401c7778 WatchSource:0}: Error finding container 27f293ec42eef2c26e03e1cccb2d06d050a8a5f7d210c09c42a88de1401c7778: Status 404 returned error can't find the container with id 27f293ec42eef2c26e03e1cccb2d06d050a8a5f7d210c09c42a88de1401c7778 Jul 29 22:45:50.949718 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:50.949697 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d65a12d350978c7bc79752021005ef.slice/crio-a37151486b8766f338d2fda533895d3b2dafd6b59eda3321dbc2bf30b6b6ff70 WatchSource:0}: Error finding container a37151486b8766f338d2fda533895d3b2dafd6b59eda3321dbc2bf30b6b6ff70: Status 404 returned error can't find the container with id a37151486b8766f338d2fda533895d3b2dafd6b59eda3321dbc2bf30b6b6ff70 Jul 29 22:45:50.956259 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.955841 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 22:45:50.961967 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.961950 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 22:45:50.967436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967413 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-run\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.967541 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967443 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-multus-certs\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967541 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967464 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a69b0251-0d36-46cc-995a-898b931b4c7a-host-slash\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.967541 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.967541 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967499 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-var-lib-kubelet\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-cnibin\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967560 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967565 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-netns\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967563 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-multus-certs\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-cni-multus\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967613 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-netns\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967621 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-cni-multus\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967626 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-run\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967632 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-ovnkube-script-lib\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967629 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-cnibin\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967656 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/565ea92c-5654-4024-b67d-9e40473eb5d3-kubelet-config\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967662 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-var-lib-kubelet\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967669 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a69b0251-0d36-46cc-995a-898b931b4c7a-host-slash\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967675 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7rh\" (UniqueName: \"kubernetes.io/projected/61e7fdac-01c6-42c3-afc7-9d99e7776404-kube-api-access-hz7rh\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-os-release\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967707 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/565ea92c-5654-4024-b67d-9e40473eb5d3-kubelet-config\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a69b0251-0d36-46cc-995a-898b931b4c7a-iptables-alerter-script\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.967742 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-system-cni-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-cni-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dff548c-59fa-4284-a249-af3cbc6608cf-konnectivity-ca\") pod \"konnectivity-agent-t9pnv\" (UID: \"8dff548c-59fa-4284-a249-af3cbc6608cf\") " pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967794 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-host\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967850 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-cni-netd\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967876 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-socket-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967890 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-system-cni-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967912 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-cni-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967940 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-device-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967940 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-cni-netd\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.967989 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-device-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.968009 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968015 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-socket-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968083 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-conf-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:50.968091 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:51.468055425 +0000 UTC m=+1.958821929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:50.968589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968123 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-conf-dir\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968148 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgssh\" (UniqueName: \"kubernetes.io/projected/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-kube-api-access-cgssh\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mwd\" (UniqueName: \"kubernetes.io/projected/a69b0251-0d36-46cc-995a-898b931b4c7a-kube-api-access-z6mwd\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968243 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-kubelet\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-var-lib-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968291 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-etc-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-registration-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968335 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-kubelet\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968340 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-var-lib-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968352 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-modprobe-d\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968368 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-etc-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968383 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a69b0251-0d36-46cc-995a-898b931b4c7a-iptables-alerter-script\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968387 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-ovnkube-script-lib\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968412 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-registration-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968386 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysctl-d\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-sys\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968448 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-modprobe-d\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.969457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968474 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-slash\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968479 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysctl-d\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968491 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-sys\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-sys-fs\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968511 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-slash\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-tuned\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968542 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-sys-fs\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-daemon-config\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-serviceca\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968585 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbdg\" (UniqueName: \"kubernetes.io/projected/2c287841-fa0f-4e19-a626-8045fcb66dad-kube-api-access-vcbdg\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968628 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjm8w\" (UniqueName: \"kubernetes.io/projected/bf3ac0df-73b0-4012-8826-271ed3cb70aa-kube-api-access-zjm8w\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968646 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968661 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-env-overrides\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968678 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968721 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-openvswitch\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968739 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.970286 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968752 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h57c9\" (UniqueName: \"kubernetes.io/projected/47025aee-d69e-40c9-bf58-30b3fd47adfb-kube-api-access-h57c9\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-tmp\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-socket-dir-parent\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968807 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysconfig\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysctl-conf\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968845 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-lib-modules\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968878 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-socket-dir-parent\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968883 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysconfig\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968897 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-etc-kubernetes\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968927 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968945 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-sysctl-conf\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968950 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-kubernetes\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968978 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-os-release\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968984 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-lib-modules\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.968994 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-etc-kubernetes\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-cni-bin\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969031 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddds9\" (UniqueName: \"kubernetes.io/projected/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-kube-api-access-ddds9\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:50.971225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969036 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-kubernetes\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969059 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-system-cni-dir\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969066 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-os-release\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969080 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-cni-bin\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-env-overrides\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969086 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-ovnkube-config\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969106 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61e7fdac-01c6-42c3-afc7-9d99e7776404-multus-daemon-config\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969149 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-hostroot\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-ovn\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969234 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtvqr\" (UniqueName: \"kubernetes.io/projected/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-kube-api-access-dtvqr\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-hostroot\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969274 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-ovn\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-k8s-cni-cncf-io\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969371 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf3ac0df-73b0-4012-8826-271ed3cb70aa-hosts-file\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969377 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-run-k8s-cni-cncf-io\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969394 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972316 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vngt7\" (UniqueName: \"kubernetes.io/projected/191bd427-74bb-4fa7-bffc-5e78e319024f-kube-api-access-vngt7\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969440 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-host\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969456 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-kubelet\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969456 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969473 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969533 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-host\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-systemd-units\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969578 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-systemd-units\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969543 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61e7fdac-01c6-42c3-afc7-9d99e7776404-host-var-lib-kubelet\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-run-netns\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969542 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/191bd427-74bb-4fa7-bffc-5e78e319024f-ovnkube-config\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969614 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-run-netns\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/565ea92c-5654-4024-b67d-9e40473eb5d3-dbus\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-node-log\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/565ea92c-5654-4024-b67d-9e40473eb5d3-dbus\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969693 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-node-log\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e7fdac-01c6-42c3-afc7-9d99e7776404-cni-binary-copy\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.972925 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-cnibin\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969811 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-systemd\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969829 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/191bd427-74bb-4fa7-bffc-5e78e319024f-ovn-node-metrics-cert\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969854 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dff548c-59fa-4284-a249-af3cbc6608cf-agent-certs\") pod \"konnectivity-agent-t9pnv\" (UID: \"8dff548c-59fa-4284-a249-af3cbc6608cf\") " pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969874 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3ac0df-73b0-4012-8826-271ed3cb70aa-tmp-dir\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969891 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-log-socket\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969938 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-cni-bin\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969949 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-run-systemd\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969965 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.969991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-systemd\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.970015 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-host-cni-bin\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.970055 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/191bd427-74bb-4fa7-bffc-5e78e319024f-log-socket\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.970076 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-systemd\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.970090 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61e7fdac-01c6-42c3-afc7-9d99e7776404-cni-binary-copy\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.970153 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47025aee-d69e-40c9-bf58-30b3fd47adfb-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.972414 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/191bd427-74bb-4fa7-bffc-5e78e319024f-ovn-node-metrics-cert\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.973489 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.972463 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-etc-tuned\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.974049 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.972483 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-tmp\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.977722 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.977693 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mwd\" (UniqueName: \"kubernetes.io/projected/a69b0251-0d36-46cc-995a-898b931b4c7a-kube-api-access-z6mwd\") pod \"iptables-alerter-x7zgx\" (UID: \"a69b0251-0d36-46cc-995a-898b931b4c7a\") " pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:50.978512 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.978485 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7rh\" (UniqueName: \"kubernetes.io/projected/61e7fdac-01c6-42c3-afc7-9d99e7776404-kube-api-access-hz7rh\") pod \"multus-hm8q4\" (UID: \"61e7fdac-01c6-42c3-afc7-9d99e7776404\") " pod="openshift-multus/multus-hm8q4" Jul 29 22:45:50.979033 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.979017 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vngt7\" (UniqueName: \"kubernetes.io/projected/191bd427-74bb-4fa7-bffc-5e78e319024f-kube-api-access-vngt7\") pod \"ovnkube-node-6tjnc\" (UID: \"191bd427-74bb-4fa7-bffc-5e78e319024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:50.979494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.979479 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtvqr\" (UniqueName: \"kubernetes.io/projected/04b1c88c-4cc7-4430-96f5-d75ac1234d8b-kube-api-access-dtvqr\") pod \"tuned-kg86g\" (UID: \"04b1c88c-4cc7-4430-96f5-d75ac1234d8b\") " pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:50.980239 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:50.980222 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h57c9\" (UniqueName: \"kubernetes.io/projected/47025aee-d69e-40c9-bf58-30b3fd47adfb-kube-api-access-h57c9\") pod \"aws-ebs-csi-driver-node-qbbnc\" (UID: \"47025aee-d69e-40c9-bf58-30b3fd47adfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:51.009308 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.009280 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:45:51.069887 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.069861 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:45:51.070492 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070473 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:51.070536 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070502 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddds9\" (UniqueName: \"kubernetes.io/projected/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-kube-api-access-ddds9\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.070576 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-system-cni-dir\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.070576 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.070656 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.070571 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:51.070656 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070612 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-system-cni-dir\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.070656 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070573 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf3ac0df-73b0-4012-8826-271ed3cb70aa-hosts-file\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.070656 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070627 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf3ac0df-73b0-4012-8826-271ed3cb70aa-hosts-file\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.070824 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.070658 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:51.570633194 +0000 UTC m=+2.061399674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:51.070824 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070709 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.070824 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-cnibin\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.070824 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070822 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-cnibin\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070841 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dff548c-59fa-4284-a249-af3cbc6608cf-agent-certs\") pod \"konnectivity-agent-t9pnv\" (UID: \"8dff548c-59fa-4284-a249-af3cbc6608cf\") " pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070868 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3ac0df-73b0-4012-8826-271ed3cb70aa-tmp-dir\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070901 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-os-release\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dff548c-59fa-4284-a249-af3cbc6608cf-konnectivity-ca\") pod \"konnectivity-agent-t9pnv\" (UID: \"8dff548c-59fa-4284-a249-af3cbc6608cf\") " pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-host\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.071005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071049 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgssh\" (UniqueName: \"kubernetes.io/projected/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-kube-api-access-cgssh\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071094 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-serviceca\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071147 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-host\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071171 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071200 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbdg\" (UniqueName: \"kubernetes.io/projected/2c287841-fa0f-4e19-a626-8045fcb66dad-kube-api-access-vcbdg\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071223 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjm8w\" (UniqueName: \"kubernetes.io/projected/bf3ac0df-73b0-4012-8826-271ed3cb70aa-kube-api-access-zjm8w\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071292 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3ac0df-73b0-4012-8826-271ed3cb70aa-tmp-dir\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.071372 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071321 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071782 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.070995 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-os-release\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071782 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071321 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071782 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071637 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c287841-fa0f-4e19-a626-8045fcb66dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.071782 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dff548c-59fa-4284-a249-af3cbc6608cf-konnectivity-ca\") pod \"konnectivity-agent-t9pnv\" (UID: \"8dff548c-59fa-4284-a249-af3cbc6608cf\") " pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:51.071782 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071767 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-serviceca\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.071957 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.071803 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c287841-fa0f-4e19-a626-8045fcb66dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.073700 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.073679 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dff548c-59fa-4284-a249-af3cbc6608cf-agent-certs\") pod \"konnectivity-agent-t9pnv\" (UID: \"8dff548c-59fa-4284-a249-af3cbc6608cf\") " pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:51.080142 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.080095 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:45:51.081027 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.081011 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:45:51.081087 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.081031 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:45:51.081087 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.081041 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:51.081087 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.081084 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:51.58107194 +0000 UTC m=+2.071838419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:51.083445 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.083416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddds9\" (UniqueName: \"kubernetes.io/projected/eb643171-ab1a-4b6d-89d9-9dac9c5a493b-kube-api-access-ddds9\") pod \"node-ca-9wvgb\" (UID: \"eb643171-ab1a-4b6d-89d9-9dac9c5a493b\") " pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.084181 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.084156 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjm8w\" (UniqueName: \"kubernetes.io/projected/bf3ac0df-73b0-4012-8826-271ed3cb70aa-kube-api-access-zjm8w\") pod \"node-resolver-dm4l8\" (UID: \"bf3ac0df-73b0-4012-8826-271ed3cb70aa\") " pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.084624 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.084592 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbdg\" (UniqueName: \"kubernetes.io/projected/2c287841-fa0f-4e19-a626-8045fcb66dad-kube-api-access-vcbdg\") pod \"multus-additional-cni-plugins-gnwtp\" (UID: \"2c287841-fa0f-4e19-a626-8045fcb66dad\") " pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.085261 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.085241 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgssh\" (UniqueName: \"kubernetes.io/projected/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-kube-api-access-cgssh\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:51.173285 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.173194 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" Jul 29 22:45:51.183949 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.183921 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47025aee_d69e_40c9_bf58_30b3fd47adfb.slice/crio-73b35a205e8b0b27423d2bf7987ecb1a48d6d0de265ed81e80b535c5f0eaeaeb WatchSource:0}: Error finding container 73b35a205e8b0b27423d2bf7987ecb1a48d6d0de265ed81e80b535c5f0eaeaeb: Status 404 returned error can't find the container with id 73b35a205e8b0b27423d2bf7987ecb1a48d6d0de265ed81e80b535c5f0eaeaeb Jul 29 22:45:51.188522 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.188505 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kg86g" Jul 29 22:45:51.196870 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.196842 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b1c88c_4cc7_4430_96f5_d75ac1234d8b.slice/crio-76493d4fce96d43077a659d2d22252cad937b9a3be03739ce9793d19289d3002 WatchSource:0}: Error finding container 76493d4fce96d43077a659d2d22252cad937b9a3be03739ce9793d19289d3002: Status 404 returned error can't find the container with id 76493d4fce96d43077a659d2d22252cad937b9a3be03739ce9793d19289d3002 Jul 29 22:45:51.210753 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.210730 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7zgx" Jul 29 22:45:51.210753 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.210740 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hm8q4" Jul 29 22:45:51.220963 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.220929 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e7fdac_01c6_42c3_afc7_9d99e7776404.slice/crio-5ff34ed0fc20d2b5d456628273e31f11ff397f080f1f52fb82445b1d1c8ece19 WatchSource:0}: Error finding container 5ff34ed0fc20d2b5d456628273e31f11ff397f080f1f52fb82445b1d1c8ece19: Status 404 returned error can't find the container with id 5ff34ed0fc20d2b5d456628273e31f11ff397f080f1f52fb82445b1d1c8ece19 Jul 29 22:45:51.224805 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.224783 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69b0251_0d36_46cc_995a_898b931b4c7a.slice/crio-0c1aa0eb4f035457fcb5c48080caaaccb8b145c6176d0aa77811262084d937b6 WatchSource:0}: Error finding container 0c1aa0eb4f035457fcb5c48080caaaccb8b145c6176d0aa77811262084d937b6: Status 404 returned error can't find the container with id 0c1aa0eb4f035457fcb5c48080caaaccb8b145c6176d0aa77811262084d937b6 Jul 29 22:45:51.226016 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.225997 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:45:51.235091 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.235065 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:45:51.235315 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.235296 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191bd427_74bb_4fa7_bffc_5e78e319024f.slice/crio-25b3f202109af0a7afe18f375ca88f0372c6254431149d9f9d613313d830bc2c WatchSource:0}: Error finding container 25b3f202109af0a7afe18f375ca88f0372c6254431149d9f9d613313d830bc2c: Status 404 returned error can't find the container with id 25b3f202109af0a7afe18f375ca88f0372c6254431149d9f9d613313d830bc2c Jul 29 22:45:51.243466 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.243444 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dff548c_59fa_4284_a249_af3cbc6608cf.slice/crio-21393c2350f8b61e2cc83ce5d094c94976566a477406166d196500b532d8cd78 WatchSource:0}: Error finding container 21393c2350f8b61e2cc83ce5d094c94976566a477406166d196500b532d8cd78: Status 404 returned error can't find the container with id 21393c2350f8b61e2cc83ce5d094c94976566a477406166d196500b532d8cd78 Jul 29 22:45:51.250639 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.250620 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dm4l8" Jul 29 22:45:51.258704 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.258674 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3ac0df_73b0_4012_8826_271ed3cb70aa.slice/crio-b069daebd376ed8fd17788418b997435178581ce6859b9afb84b166ad5a19c17 WatchSource:0}: Error finding container b069daebd376ed8fd17788418b997435178581ce6859b9afb84b166ad5a19c17: Status 404 returned error can't find the container with id b069daebd376ed8fd17788418b997435178581ce6859b9afb84b166ad5a19c17 Jul 29 22:45:51.258833 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.258735 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wvgb" Jul 29 22:45:51.264626 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.264606 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" Jul 29 22:45:51.267760 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.267744 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb643171_ab1a_4b6d_89d9_9dac9c5a493b.slice/crio-965f5617fd4bafcc270daca1b10e85632f117e6fbf8b990fd33d79b19e5908fe WatchSource:0}: Error finding container 965f5617fd4bafcc270daca1b10e85632f117e6fbf8b990fd33d79b19e5908fe: Status 404 returned error can't find the container with id 965f5617fd4bafcc270daca1b10e85632f117e6fbf8b990fd33d79b19e5908fe Jul 29 22:45:51.273407 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:45:51.273378 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c287841_fa0f_4e19_a626_8045fcb66dad.slice/crio-e80b7f608b63d56db757120b1fd1afae2f5cb36a8408e449bf57150a68e606ed WatchSource:0}: Error finding container e80b7f608b63d56db757120b1fd1afae2f5cb36a8408e449bf57150a68e606ed: Status 404 returned error can't find the container with id e80b7f608b63d56db757120b1fd1afae2f5cb36a8408e449bf57150a68e606ed Jul 29 22:45:51.474305 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.474222 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:51.474434 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.474335 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:51.474434 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.474387 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:52.474373509 +0000 UTC m=+2.965139974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:51.574687 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.574657 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:51.574866 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.574782 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:51.574866 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.574835 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:52.574820984 +0000 UTC m=+3.065587449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:51.675608 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.674984 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:51.675608 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.675165 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:45:51.675608 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.675186 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:45:51.675608 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.675201 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:51.675608 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:51.675259 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:52.675238494 +0000 UTC m=+3.166004984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:51.933279 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.933096 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 22:40:51 +0000 UTC" deadline="2028-03-20 13:09:30.341604311 +0000 UTC" Jul 29 22:45:51.933279 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.933165 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14390h23m38.408443854s" Jul 29 22:45:51.934819 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.933334 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" event={"ID":"47025aee-d69e-40c9-bf58-30b3fd47adfb","Type":"ContainerStarted","Data":"73b35a205e8b0b27423d2bf7987ecb1a48d6d0de265ed81e80b535c5f0eaeaeb"} Jul 29 22:45:51.960028 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.959987 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wvgb" event={"ID":"eb643171-ab1a-4b6d-89d9-9dac9c5a493b","Type":"ContainerStarted","Data":"965f5617fd4bafcc270daca1b10e85632f117e6fbf8b990fd33d79b19e5908fe"} Jul 29 22:45:51.975116 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.975049 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hm8q4" event={"ID":"61e7fdac-01c6-42c3-afc7-9d99e7776404","Type":"ContainerStarted","Data":"5ff34ed0fc20d2b5d456628273e31f11ff397f080f1f52fb82445b1d1c8ece19"} Jul 29 22:45:51.982459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:51.982361 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" event={"ID":"89d65a12d350978c7bc79752021005ef","Type":"ContainerStarted","Data":"a37151486b8766f338d2fda533895d3b2dafd6b59eda3321dbc2bf30b6b6ff70"} Jul 29 22:45:52.030339 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.030222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" event={"ID":"117d5dfc69795e65811eb7e229dc6f0e","Type":"ContainerStarted","Data":"27f293ec42eef2c26e03e1cccb2d06d050a8a5f7d210c09c42a88de1401c7778"} Jul 29 22:45:52.042356 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.042317 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerStarted","Data":"e80b7f608b63d56db757120b1fd1afae2f5cb36a8408e449bf57150a68e606ed"} Jul 29 22:45:52.052761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.052670 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dm4l8" event={"ID":"bf3ac0df-73b0-4012-8826-271ed3cb70aa","Type":"ContainerStarted","Data":"b069daebd376ed8fd17788418b997435178581ce6859b9afb84b166ad5a19c17"} Jul 29 22:45:52.070258 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.070137 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9pnv" event={"ID":"8dff548c-59fa-4284-a249-af3cbc6608cf","Type":"ContainerStarted","Data":"21393c2350f8b61e2cc83ce5d094c94976566a477406166d196500b532d8cd78"} Jul 29 22:45:52.084937 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.084903 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"25b3f202109af0a7afe18f375ca88f0372c6254431149d9f9d613313d830bc2c"} Jul 29 22:45:52.115198 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.115147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7zgx" event={"ID":"a69b0251-0d36-46cc-995a-898b931b4c7a","Type":"ContainerStarted","Data":"0c1aa0eb4f035457fcb5c48080caaaccb8b145c6176d0aa77811262084d937b6"} Jul 29 22:45:52.158010 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.157942 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kg86g" event={"ID":"04b1c88c-4cc7-4430-96f5-d75ac1234d8b","Type":"ContainerStarted","Data":"76493d4fce96d43077a659d2d22252cad937b9a3be03739ce9793d19289d3002"} Jul 29 22:45:52.482651 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.482503 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:52.482651 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.482654 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:52.483020 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.482723 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:54.48270285 +0000 UTC m=+4.973469340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:52.583319 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.583275 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:52.583499 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.583417 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:52.583499 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.583482 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:54.583463301 +0000 UTC m=+5.074229771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:52.683833 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.683793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:52.684497 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.684024 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:45:52.684497 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.684051 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:45:52.684497 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.684065 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:52.684497 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.684120 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:54.684103243 +0000 UTC m=+5.174869727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:52.919551 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.919466 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:52.919717 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.919608 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:45:52.920048 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.920026 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:52.920166 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.920146 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:45:52.920264 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.920235 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:52.920331 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:52.920312 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:45:52.934307 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.934261 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 22:40:51 +0000 UTC" deadline="2028-03-12 10:50:58.21177829 +0000 UTC" Jul 29 22:45:52.934307 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:52.934306 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14196h5m5.277477796s" Jul 29 22:45:54.504816 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:54.503095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:54.504816 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.503300 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:54.504816 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.503363 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:58.50334485 +0000 UTC m=+8.994111318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:54.603834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:54.603787 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:54.604041 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.603990 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:54.604108 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.604062 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:58.604041772 +0000 UTC m=+9.094808239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:54.707555 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:54.707512 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:54.707730 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.707711 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:45:54.707806 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.707733 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:45:54.707806 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.707746 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:54.707922 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.707809 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:45:58.707787793 +0000 UTC m=+9.198554284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:54.919892 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:54.919807 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:54.920064 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:54.919909 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:54.920064 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.919919 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:45:54.920064 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.920025 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:45:54.920276 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:54.920095 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:54.920276 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:54.920249 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:45:56.919602 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:56.919526 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:56.919602 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:56.919566 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:56.919602 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:56.919570 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:56.920235 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:56.919688 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:45:56.920235 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:56.920072 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:45:56.920235 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:56.920182 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:45:58.542053 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:58.542013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:58.542509 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.542151 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:58.542509 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.542211 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:06.542192259 +0000 UTC m=+17.032958726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:45:58.643252 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:58.643213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:58.643418 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.643356 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:58.643465 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.643434 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:06.643413335 +0000 UTC m=+17.134179801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:45:58.744221 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:58.744187 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:58.744429 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.744406 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:45:58.744485 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.744438 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:45:58.744485 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.744453 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:58.744562 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.744519 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:06.744499342 +0000 UTC m=+17.235265805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:45:58.919796 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:58.919714 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:45:58.919974 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:58.919715 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:45:58.919974 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.919845 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:45:58.919974 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.919912 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:45:58.919974 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:45:58.919727 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:45:58.920220 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:45:58.919990 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:00.919483 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:00.919448 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:00.919881 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:00.919580 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:00.919964 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:00.919938 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:00.920089 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:00.920058 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:00.920161 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:00.920118 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:00.920222 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:00.920185 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:02.919258 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:02.919221 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:02.919735 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:02.919221 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:02.919735 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:02.919335 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:02.919735 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:02.919221 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:02.919735 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:02.919370 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:02.919735 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:02.919443 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:04.919313 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:04.919275 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:04.919776 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:04.919291 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:04.919776 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:04.919404 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:04.919776 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:04.919429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:04.919776 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:04.919548 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:04.919776 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:04.919637 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:06.605288 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:06.605248 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:06.605745 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.605408 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:06.605745 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.605471 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:22.605455611 +0000 UTC m=+33.096222075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:06.705835 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:06.705798 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:06.706034 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.705981 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:06.706090 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.706057 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:22.706038283 +0000 UTC m=+33.196804753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:06.806892 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:06.806849 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:06.807056 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.807028 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:06.807056 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.807049 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:06.807158 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.807061 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:06.807158 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.807131 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:22.807116032 +0000 UTC m=+33.297882631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:06.919396 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:06.919305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:06.919396 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:06.919330 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:06.919396 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:06.919316 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:06.919653 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.919421 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:06.919653 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.919500 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:06.919653 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:06.919621 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:08.919614 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:08.919379 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:08.920054 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:08.919395 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:08.920054 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:08.919734 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:08.920054 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:08.919421 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:08.920054 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:08.919775 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:08.920054 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:08.919850 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:10.919819 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:10.919783 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:10.920291 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:10.919899 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:10.920291 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:10.919911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:10.920291 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:10.919905 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:10.920291 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:10.920030 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:10.920291 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:10.920086 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:12.204343 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.204095 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dm4l8" event={"ID":"bf3ac0df-73b0-4012-8826-271ed3cb70aa","Type":"ContainerStarted","Data":"0e9f91da1653145162758c192bab4230fe3069916fa20e21bb662bf9f4bbf553"} Jul 29 22:46:12.205733 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.205711 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9pnv" event={"ID":"8dff548c-59fa-4284-a249-af3cbc6608cf","Type":"ContainerStarted","Data":"b6cf599c58856e78a9d0cad4012c9469f5dc8e6d44f1ba1f00fa76cd980ef635"} Jul 29 22:46:12.207843 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.207823 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"df6ac364b66c18615d7e72bc9dc0f850f2f4f400b308e15c8d2829c9d28dd2f5"} Jul 29 22:46:12.207928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.207877 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"7c2dc80706c9b4d091d60af19360a114258f1c8aa30c377ee01238f1b31d1d25"} Jul 29 22:46:12.207928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.207917 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"19258e469cdaa29719490dd3a9b3ccd8285602a2dd5a6fbad49d6f2d4a3c952b"} Jul 29 22:46:12.208026 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.207953 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"e6a72ac52e8152e6e596c05954fb159d1c43a6320d230d34f829429fa41f2197"} Jul 29 22:46:12.209088 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.209071 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kg86g" event={"ID":"04b1c88c-4cc7-4430-96f5-d75ac1234d8b","Type":"ContainerStarted","Data":"0fb5efce53169248d0af974bca18181eeba4cb8b5eebafb5513127176f58908a"} Jul 29 22:46:12.210462 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.210439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" event={"ID":"47025aee-d69e-40c9-bf58-30b3fd47adfb","Type":"ContainerStarted","Data":"dd1c8e4f346b108379e43b19eda0ae2767d92287c3832a1e683ff6a1344f826b"} Jul 29 22:46:12.211677 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.211648 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wvgb" event={"ID":"eb643171-ab1a-4b6d-89d9-9dac9c5a493b","Type":"ContainerStarted","Data":"e4cdcbbf23e9819a6cb3632b99013d1766309f6acc263ab8834cfb4d8fc9ac04"} Jul 29 22:46:12.212962 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.212944 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hm8q4" event={"ID":"61e7fdac-01c6-42c3-afc7-9d99e7776404","Type":"ContainerStarted","Data":"5363bb19bceeb50936d1f571119f9f5711049c7c6a6a38d73d39d387cda6e79e"} Jul 29 22:46:12.214207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.214187 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" event={"ID":"89d65a12d350978c7bc79752021005ef","Type":"ContainerStarted","Data":"722df84f38c3a112ab65ccc8d55536c013bfa3e26fa1af9388f2831dd7063ae9"} Jul 29 22:46:12.215413 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.215393 2569 generic.go:356] "Generic (PLEG): container finished" podID="117d5dfc69795e65811eb7e229dc6f0e" containerID="0b10ac89df0f2883e55d7800607681fb1bec39098c591b755dcae1b79014a793" exitCode=0 Jul 29 22:46:12.215487 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.215459 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" event={"ID":"117d5dfc69795e65811eb7e229dc6f0e","Type":"ContainerDied","Data":"0b10ac89df0f2883e55d7800607681fb1bec39098c591b755dcae1b79014a793"} Jul 29 22:46:12.216907 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.216817 2569 generic.go:356] "Generic (PLEG): container finished" podID="2c287841-fa0f-4e19-a626-8045fcb66dad" containerID="de7661de1e6e76563960cdefd5ce4dbb6c51f546b0fab889208dc4a4f5fc9b3f" exitCode=0 Jul 29 22:46:12.216907 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.216847 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerDied","Data":"de7661de1e6e76563960cdefd5ce4dbb6c51f546b0fab889208dc4a4f5fc9b3f"} Jul 29 22:46:12.221896 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.221847 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dm4l8" podStartSLOduration=1.913742373 podStartE2EDuration="22.221820551s" totalImagesPullingTime="20.308078178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:12.221704212 +0000 UTC m=+22.712470696" watchObservedRunningTime="2026-07-29 22:46:12.221820551 +0000 UTC m=+22.712587036" Jul 29 22:46:12.251680 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.251517 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t9pnv" podStartSLOduration=1.957678142 podStartE2EDuration="22.251502054s" totalImagesPullingTime="20.293823912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:12.251192639 +0000 UTC m=+22.741959123" watchObservedRunningTime="2026-07-29 22:46:12.251502054 +0000 UTC m=+22.742268539" Jul 29 22:46:12.286140 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.285869 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" podStartSLOduration=21.285854212 podStartE2EDuration="21.285854212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:12.268460397 +0000 UTC m=+22.759226883" watchObservedRunningTime="2026-07-29 22:46:12.285854212 +0000 UTC m=+22.776620708" Jul 29 22:46:12.286140 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.286094 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kg86g" podStartSLOduration=1.9181750279999998 podStartE2EDuration="22.286082008s" totalImagesPullingTime="20.36790698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:12.285615153 +0000 UTC m=+22.776381642" watchObservedRunningTime="2026-07-29 22:46:12.286082008 +0000 UTC m=+22.776848493" Jul 29 22:46:12.304923 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.304884 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hm8q4" podStartSLOduration=1.927225655 podStartE2EDuration="22.304869405s" totalImagesPullingTime="20.37764375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:12.304471601 +0000 UTC m=+22.795238087" watchObservedRunningTime="2026-07-29 22:46:12.304869405 +0000 UTC m=+22.795635890" Jul 29 22:46:12.325283 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.325241 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9wvgb" podStartSLOduration=2.056590468 podStartE2EDuration="22.325228493s" totalImagesPullingTime="20.268638025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:12.325229225 +0000 UTC m=+22.815995710" watchObservedRunningTime="2026-07-29 22:46:12.325228493 +0000 UTC m=+22.815994978" Jul 29 22:46:12.919844 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.919765 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:12.919844 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.919781 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:12.919844 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:12.919791 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:12.920136 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:12.919895 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:12.920136 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:12.920010 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:12.920136 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:12.920086 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:13.221674 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.221584 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" event={"ID":"117d5dfc69795e65811eb7e229dc6f0e","Type":"ContainerStarted","Data":"1fe61158d904aa0a5a6f596bf4bf338105b29121b699eb4dfa82cd09b557f0a4"} Jul 29 22:46:13.225716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.225687 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"f6c0c784e6b2d98c41bbcf88552522d9c7733a10db0f9230f494d006406f7f32"} Jul 29 22:46:13.225858 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.225767 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"a914dbf12c4ffa3477d412b9ad6419d556e828193a993b4a1a8e80195bcb4150"} Jul 29 22:46:13.227211 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.227184 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7zgx" event={"ID":"a69b0251-0d36-46cc-995a-898b931b4c7a","Type":"ContainerStarted","Data":"ab91ffe93849fe95e2341d9675e8d148956680d6207f5f3482aec5d7b05a0f72"} Jul 29 22:46:13.239193 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.239148 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" podStartSLOduration=22.239133713 podStartE2EDuration="22.239133713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:13.238731235 +0000 UTC m=+23.729497722" watchObservedRunningTime="2026-07-29 22:46:13.239133713 +0000 UTC m=+23.729900195" Jul 29 22:46:13.678211 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.678172 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 22:46:13.932237 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.932073 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T22:46:13.678205364Z","UUID":"8a326409-604c-4197-8365-0a3c6cdfd679","Handler":null,"Name":"","Endpoint":""} Jul 29 22:46:13.934083 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.934055 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 22:46:13.934235 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:13.934093 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 22:46:14.231599 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.231501 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" event={"ID":"47025aee-d69e-40c9-bf58-30b3fd47adfb","Type":"ContainerStarted","Data":"5214ba9f49b92cf5e213b2df68e0c407cfce88d0f1304647ed06fb5de40e2441"} Jul 29 22:46:14.450195 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.450146 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:46:14.450824 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.450802 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:46:14.468238 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.468200 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7zgx" podStartSLOduration=4.155954868 podStartE2EDuration="24.468186s" totalImagesPullingTime="20.312231132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:13.257243954 +0000 UTC m=+23.748010438" watchObservedRunningTime="2026-07-29 22:46:14.468186 +0000 UTC m=+24.958952484" Jul 29 22:46:14.920121 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.920017 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:14.920121 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.920062 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:14.920121 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:14.920062 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:14.920355 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:14.920164 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:14.920355 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:14.920261 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:14.920355 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:14.920346 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:15.236466 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:15.236382 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" event={"ID":"47025aee-d69e-40c9-bf58-30b3fd47adfb","Type":"ContainerStarted","Data":"9d8529e5aeb1b3b8f587f2993db1e341041842f62752ed60044d77917a13ccb1"} Jul 29 22:46:15.240159 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:15.240132 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 22:46:15.240159 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:15.240141 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"46631e08399ecd19e6b200aa862a8f40cd6c4761879f4651b40482de5abe4fa9"} Jul 29 22:46:15.259157 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:15.259099 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbbnc" podStartSLOduration=2.08657074 podStartE2EDuration="25.259083044s" totalImagesPullingTime="23.172512304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:15.25893023 +0000 UTC m=+25.749696717" watchObservedRunningTime="2026-07-29 22:46:15.259083044 +0000 UTC m=+25.749849528" Jul 29 22:46:15.925835 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:15.925808 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:46:15.926399 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:15.926374 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t9pnv" Jul 29 22:46:16.919634 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:16.919604 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:16.919634 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:16.919638 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:16.920374 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:16.919649 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:16.920374 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:16.919749 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:16.920374 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:16.919832 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:16.920374 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:16.919909 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:17.246761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.246719 2569 generic.go:356] "Generic (PLEG): container finished" podID="2c287841-fa0f-4e19-a626-8045fcb66dad" containerID="d4e70163a631c4b7d7200c5f02177f07976bdb351121816471f53ecc9879f986" exitCode=0 Jul 29 22:46:17.246915 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.246838 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerDied","Data":"d4e70163a631c4b7d7200c5f02177f07976bdb351121816471f53ecc9879f986"} Jul 29 22:46:17.250549 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.250527 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" event={"ID":"191bd427-74bb-4fa7-bffc-5e78e319024f","Type":"ContainerStarted","Data":"01a7c64c446c5780072f2f239b27a6f81a9948d4164073b204e2a6160da2f148"} Jul 29 22:46:17.250806 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.250791 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:46:17.254161 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.251282 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:46:17.268296 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.268272 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:46:17.299909 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:17.299857 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" podStartSLOduration=6.825374755 podStartE2EDuration="27.299841835s" totalImagesPullingTime="20.47446708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:17.2984111 +0000 UTC m=+27.789177585" watchObservedRunningTime="2026-07-29 22:46:17.299841835 +0000 UTC m=+27.790608319" Jul 29 22:46:18.253320 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.253287 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:46:18.267901 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.267744 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:46:18.801423 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.801354 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t2fvl"] Jul 29 22:46:18.801557 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.801463 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:18.801557 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:18.801540 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:18.805884 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.805860 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxq2f"] Jul 29 22:46:18.806005 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.805953 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:18.806067 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:18.806019 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:18.812884 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.812858 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wrq56"] Jul 29 22:46:18.812978 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:18.812951 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:18.813037 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:18.813024 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:19.256882 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:19.256795 2569 generic.go:356] "Generic (PLEG): container finished" podID="2c287841-fa0f-4e19-a626-8045fcb66dad" containerID="7c2b6fccb41c7a9047e117b5e55a20e0b63f251441e5737f197522b032a611a5" exitCode=0 Jul 29 22:46:19.256882 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:19.256878 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerDied","Data":"7c2b6fccb41c7a9047e117b5e55a20e0b63f251441e5737f197522b032a611a5"} Jul 29 22:46:19.920657 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:19.920628 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:19.920835 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:19.920746 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:20.261533 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:20.261499 2569 generic.go:356] "Generic (PLEG): container finished" podID="2c287841-fa0f-4e19-a626-8045fcb66dad" containerID="e0245abb4905fc7ccf5a210692a7ae14d9d09dbdb1e954e53433b54a0d23aadb" exitCode=0 Jul 29 22:46:20.261906 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:20.261586 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerDied","Data":"e0245abb4905fc7ccf5a210692a7ae14d9d09dbdb1e954e53433b54a0d23aadb"} Jul 29 22:46:20.919274 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:20.919188 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:20.919441 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:20.919203 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:20.919441 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:20.919321 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:20.919441 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:20.919379 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:21.920072 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:21.919992 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:21.920563 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:21.920139 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:22.625536 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:22.625503 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:22.625730 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.625614 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:22.625730 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.625674 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret podName:565ea92c-5654-4024-b67d-9e40473eb5d3 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:54.625657566 +0000 UTC m=+65.116424031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret") pod "global-pull-secret-syncer-t2fvl" (UID: "565ea92c-5654-4024-b67d-9e40473eb5d3") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:22.726568 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:22.726531 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:22.726741 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.726702 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:22.726802 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.726777 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:54.72675575 +0000 UTC m=+65.217522228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:22.827834 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:22.827800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:22.828011 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.827954 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:22.828011 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.827974 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:22.828011 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.827990 2569 projected.go:196] Error preparing data for projected volume kube-api-access-g6r5k for pod openshift-network-diagnostics/network-check-target-lxq2f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:22.828130 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.828045 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k podName:38125471-addd-487e-bea4-c00f9750ed19 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:54.828029012 +0000 UTC m=+65.318795489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g6r5k" (UniqueName: "kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k") pod "network-check-target-lxq2f" (UID: "38125471-addd-487e-bea4-c00f9750ed19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:22.919851 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:22.919775 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:22.920012 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.919917 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2fvl" podUID="565ea92c-5654-4024-b67d-9e40473eb5d3" Jul 29 22:46:22.920012 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:22.919966 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:22.920147 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:22.920123 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxq2f" podUID="38125471-addd-487e-bea4-c00f9750ed19" Jul 29 22:46:23.920061 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:23.920027 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:23.920263 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:23.920195 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrq56" podUID="b9da78ca-7140-40c1-8f6e-cf9e8e74ee31" Jul 29 22:46:24.325429 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.325354 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeReady" Jul 29 22:46:24.325571 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.325509 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 22:46:24.360142 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.360094 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64cd5fb486-xcbcq"] Jul 29 22:46:24.380748 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.380712 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dnwls"] Jul 29 22:46:24.380918 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.380828 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.383225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.383204 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 22:46:24.383225 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.383222 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwgrj\"" Jul 29 22:46:24.383428 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.383230 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 22:46:24.383428 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.383290 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 22:46:24.389007 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.388989 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 22:46:24.393952 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.393879 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64cd5fb486-xcbcq"] Jul 29 22:46:24.393952 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.393920 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bqmnm"] Jul 29 22:46:24.394128 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.394028 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.396353 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.396333 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 22:46:24.396440 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.396367 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 22:46:24.396440 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.396367 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lczg\"" Jul 29 22:46:24.414067 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.414045 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqmnm"] Jul 29 22:46:24.414197 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.414075 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dnwls"] Jul 29 22:46:24.414197 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.414173 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.416363 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.416346 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 22:46:24.416596 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.416580 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 22:46:24.416680 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.416621 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-csnkl\"" Jul 29 22:46:24.416733 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.416690 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 22:46:24.538677 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538646 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a99368f-26f7-4928-a704-176d5208dad2-ca-trust-extracted\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.538677 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538679 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-registry-certificates\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.538874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538702 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-installation-pull-secrets\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.538874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538722 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54ec08b6-cb98-4382-ab3e-15cabb772d5b-config-volume\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.538874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538742 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-image-registry-private-configuration\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.538874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ec08b6-cb98-4382-ab3e-15cabb772d5b-tmp-dir\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.538874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538841 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.538874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d476d7f-1f21-4302-990e-42abb089d203-cert\") pod \"ingress-canary-bqmnm\" (UID: \"3d476d7f-1f21-4302-990e-42abb089d203\") " pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.539070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tfw\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-kube-api-access-x5tfw\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.539070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gw2q\" (UniqueName: \"kubernetes.io/projected/54ec08b6-cb98-4382-ab3e-15cabb772d5b-kube-api-access-2gw2q\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.539070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-552qs\" (UniqueName: \"kubernetes.io/projected/3d476d7f-1f21-4302-990e-42abb089d203-kube-api-access-552qs\") pod \"ingress-canary-bqmnm\" (UID: \"3d476d7f-1f21-4302-990e-42abb089d203\") " pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.539070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.539070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538961 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-trusted-ca\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.539070 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.538993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-bound-sa-token\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640000 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.639914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-installation-pull-secrets\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640000 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.639952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54ec08b6-cb98-4382-ab3e-15cabb772d5b-config-volume\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.640000 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.639977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-image-registry-private-configuration\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640305 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640046 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ec08b6-cb98-4382-ab3e-15cabb772d5b-tmp-dir\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.640305 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.640305 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d476d7f-1f21-4302-990e-42abb089d203-cert\") pod \"ingress-canary-bqmnm\" (UID: \"3d476d7f-1f21-4302-990e-42abb089d203\") " pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.640305 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:24.640272 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640303 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ec08b6-cb98-4382-ab3e-15cabb772d5b-tmp-dir\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:24.640348 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:46:25.140328586 +0000 UTC m=+35.631095073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640369 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tfw\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-kube-api-access-x5tfw\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gw2q\" (UniqueName: \"kubernetes.io/projected/54ec08b6-cb98-4382-ab3e-15cabb772d5b-kube-api-access-2gw2q\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-552qs\" (UniqueName: \"kubernetes.io/projected/3d476d7f-1f21-4302-990e-42abb089d203-kube-api-access-552qs\") pod \"ingress-canary-bqmnm\" (UID: \"3d476d7f-1f21-4302-990e-42abb089d203\") " pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640449 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-trusted-ca\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640522 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-bound-sa-token\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a99368f-26f7-4928-a704-176d5208dad2-ca-trust-extracted\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640573 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-registry-certificates\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.640595 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54ec08b6-cb98-4382-ab3e-15cabb772d5b-config-volume\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:24.640754 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:24.640820 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:24.640880 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:24.640873 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:25.140857205 +0000 UTC m=+35.631623667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:24.641863 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.641671 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-registry-certificates\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.641863 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.641781 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a99368f-26f7-4928-a704-176d5208dad2-ca-trust-extracted\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.643056 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.643027 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-trusted-ca\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.644860 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.644831 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-image-registry-private-configuration\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.645039 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.645022 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d476d7f-1f21-4302-990e-42abb089d203-cert\") pod \"ingress-canary-bqmnm\" (UID: \"3d476d7f-1f21-4302-990e-42abb089d203\") " pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.645167 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.645036 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-installation-pull-secrets\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.651731 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.651660 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-552qs\" (UniqueName: \"kubernetes.io/projected/3d476d7f-1f21-4302-990e-42abb089d203-kube-api-access-552qs\") pod \"ingress-canary-bqmnm\" (UID: \"3d476d7f-1f21-4302-990e-42abb089d203\") " pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.653312 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.653287 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gw2q\" (UniqueName: \"kubernetes.io/projected/54ec08b6-cb98-4382-ab3e-15cabb772d5b-kube-api-access-2gw2q\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:24.653391 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.653292 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-bound-sa-token\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.653846 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.653825 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tfw\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-kube-api-access-x5tfw\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:24.721839 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.721799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqmnm" Jul 29 22:46:24.920080 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.920054 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:24.920247 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.920232 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:24.923072 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.923054 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 22:46:24.923653 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.923058 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbmzc\"" Jul 29 22:46:24.923653 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.923292 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 22:46:24.923653 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.923329 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 22:46:24.978646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:24.978613 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqmnm"] Jul 29 22:46:24.985099 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:46:24.985073 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d476d7f_1f21_4302_990e_42abb089d203.slice/crio-ac5a4e03a9e46ca98cf01aae64e12cf58b2eca30785ddaf6237a43ecb0614466 WatchSource:0}: Error finding container ac5a4e03a9e46ca98cf01aae64e12cf58b2eca30785ddaf6237a43ecb0614466: Status 404 returned error can't find the container with id ac5a4e03a9e46ca98cf01aae64e12cf58b2eca30785ddaf6237a43ecb0614466 Jul 29 22:46:25.144099 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.143996 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:25.144099 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.144095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:25.144275 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:25.144183 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:25.144275 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:25.144201 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:25.144275 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:25.144253 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:46:26.144240571 +0000 UTC m=+36.635007034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:25.144406 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:25.144204 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:25.144406 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:25.144344 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:26.144327208 +0000 UTC m=+36.635093676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:25.275666 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.275633 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqmnm" event={"ID":"3d476d7f-1f21-4302-990e-42abb089d203","Type":"ContainerStarted","Data":"ac5a4e03a9e46ca98cf01aae64e12cf58b2eca30785ddaf6237a43ecb0614466"} Jul 29 22:46:25.278064 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.278036 2569 generic.go:356] "Generic (PLEG): container finished" podID="2c287841-fa0f-4e19-a626-8045fcb66dad" containerID="fadc841c692af91f7a6fe327a5ad90381f695f75b220eb8cbf0a92f759075b1f" exitCode=0 Jul 29 22:46:25.278215 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.278085 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerDied","Data":"fadc841c692af91f7a6fe327a5ad90381f695f75b220eb8cbf0a92f759075b1f"} Jul 29 22:46:25.919894 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.919668 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:25.922687 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.922663 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 22:46:25.922822 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:25.922668 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4fq52\"" Jul 29 22:46:26.150073 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:26.150043 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:26.150643 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:26.150145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:26.150643 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:26.150232 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:26.150643 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:26.150269 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:26.150643 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:26.150285 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:26.150643 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:26.150302 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:46:28.150280486 +0000 UTC m=+38.641046969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:26.150643 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:26.150325 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:28.150313373 +0000 UTC m=+38.641079841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:26.283488 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:26.283409 2569 generic.go:356] "Generic (PLEG): container finished" podID="2c287841-fa0f-4e19-a626-8045fcb66dad" containerID="b452ee044bf4fa5b075d355a84588bbfdb5789f122cf6522533bc5127ecadea3" exitCode=0 Jul 29 22:46:26.283621 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:26.283487 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerDied","Data":"b452ee044bf4fa5b075d355a84588bbfdb5789f122cf6522533bc5127ecadea3"} Jul 29 22:46:27.290619 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:27.290528 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" event={"ID":"2c287841-fa0f-4e19-a626-8045fcb66dad","Type":"ContainerStarted","Data":"5d80a6bf08e848b9c02e7bc949efeb874917dd4e888a13629b22e3faeb69451c"} Jul 29 22:46:27.318049 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:27.317986 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gnwtp" podStartSLOduration=5.627437994 podStartE2EDuration="37.317962946s" totalImagesPullingTime="31.690524952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:27.316472926 +0000 UTC m=+37.807239411" watchObservedRunningTime="2026-07-29 22:46:27.317962946 +0000 UTC m=+37.808729409" Jul 29 22:46:28.166985 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:28.166943 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:28.167216 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:28.167010 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:28.167216 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:28.167095 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:28.167216 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:28.167141 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:28.167216 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:28.167156 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:28.167216 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:28.167176 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:46:32.167159806 +0000 UTC m=+42.657926274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:28.167216 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:28.167202 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:32.167187707 +0000 UTC m=+42.657954170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:28.294431 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:28.294342 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqmnm" event={"ID":"3d476d7f-1f21-4302-990e-42abb089d203","Type":"ContainerStarted","Data":"52c4e7f6aa36cf23f53847e193dad8391fb9e810b9c1859eadef8a6ed0199906"} Jul 29 22:46:28.312592 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:28.312547 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bqmnm" podStartSLOduration=1.318391052 podStartE2EDuration="4.312530639s" totalImagesPullingTime="2.994139587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:28.311302994 +0000 UTC m=+38.802069480" watchObservedRunningTime="2026-07-29 22:46:28.312530639 +0000 UTC m=+38.803297123" Jul 29 22:46:32.196123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:32.196063 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:32.196123 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:32.196131 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:32.196537 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:32.196221 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:32.196537 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:32.196235 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:32.196537 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:32.196246 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:32.196537 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:32.196283 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:46:40.196268695 +0000 UTC m=+50.687035158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:32.196537 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:32.196298 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:40.196291175 +0000 UTC m=+50.687057639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:40.256161 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:40.256101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:40.256668 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:40.256219 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:40.256668 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:40.256243 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:40.256668 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:40.256226 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:40.256668 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:40.256298 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:56.256277884 +0000 UTC m=+66.747044346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:40.256668 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:40.256315 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:40.256668 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:40.256372 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:46:56.256356809 +0000 UTC m=+66.747123273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:50.271843 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:50.271812 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tjnc" Jul 29 22:46:54.657168 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.657125 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:54.660274 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.660252 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 22:46:54.671009 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.670987 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/565ea92c-5654-4024-b67d-9e40473eb5d3-original-pull-secret\") pod \"global-pull-secret-syncer-t2fvl\" (UID: \"565ea92c-5654-4024-b67d-9e40473eb5d3\") " pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:54.758041 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.758007 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:46:54.760434 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.760417 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 22:46:54.768326 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:54.768312 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 22:46:54.768379 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:54.768363 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs podName:b9da78ca-7140-40c1-8f6e-cf9e8e74ee31 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:58.768348891 +0000 UTC m=+129.259115354 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs") pod "network-metrics-daemon-wrq56" (UID: "b9da78ca-7140-40c1-8f6e-cf9e8e74ee31") : secret "metrics-daemon-secret" not found Jul 29 22:46:54.858374 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.858344 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:54.861409 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.861385 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 22:46:54.871932 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.871912 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 22:46:54.881706 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.881677 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6r5k\" (UniqueName: \"kubernetes.io/projected/38125471-addd-487e-bea4-c00f9750ed19-kube-api-access-g6r5k\") pod \"network-check-target-lxq2f\" (UID: \"38125471-addd-487e-bea4-c00f9750ed19\") " pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:54.939262 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.939193 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2fvl" Jul 29 22:46:54.948045 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.948017 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbmzc\"" Jul 29 22:46:54.956146 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:54.956127 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:55.092347 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:55.092314 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t2fvl"] Jul 29 22:46:55.097716 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:46:55.097689 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565ea92c_5654_4024_b67d_9e40473eb5d3.slice/crio-c4d5f64f28bff49f545d797a2f6a2143f7d1c3f64f14ab44162f0190d0489d30 WatchSource:0}: Error finding container c4d5f64f28bff49f545d797a2f6a2143f7d1c3f64f14ab44162f0190d0489d30: Status 404 returned error can't find the container with id c4d5f64f28bff49f545d797a2f6a2143f7d1c3f64f14ab44162f0190d0489d30 Jul 29 22:46:55.111815 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:55.111790 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxq2f"] Jul 29 22:46:55.115137 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:46:55.115114 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38125471_addd_487e_bea4_c00f9750ed19.slice/crio-b2db1b54de4468077f7b91f80daa85bc31558f6f43a62449818b2379976f2711 WatchSource:0}: Error finding container b2db1b54de4468077f7b91f80daa85bc31558f6f43a62449818b2379976f2711: Status 404 returned error can't find the container with id b2db1b54de4468077f7b91f80daa85bc31558f6f43a62449818b2379976f2711 Jul 29 22:46:55.356880 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:55.356846 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxq2f" event={"ID":"38125471-addd-487e-bea4-c00f9750ed19","Type":"ContainerStarted","Data":"b2db1b54de4468077f7b91f80daa85bc31558f6f43a62449818b2379976f2711"} Jul 29 22:46:55.357816 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:55.357794 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t2fvl" event={"ID":"565ea92c-5654-4024-b67d-9e40473eb5d3","Type":"ContainerStarted","Data":"c4d5f64f28bff49f545d797a2f6a2143f7d1c3f64f14ab44162f0190d0489d30"} Jul 29 22:46:56.269746 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:56.269614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:46:56.269746 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:56.269679 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:46:56.270280 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:56.269797 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:46:56.270280 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:56.269799 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:56.270280 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:56.269882 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls podName:54ec08b6-cb98-4382-ab3e-15cabb772d5b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:28.269860875 +0000 UTC m=+98.760627353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls") pod "dns-default-dnwls" (UID: "54ec08b6-cb98-4382-ab3e-15cabb772d5b") : secret "dns-default-metrics-tls" not found Jul 29 22:46:56.270280 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:56.269813 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fb486-xcbcq: secret "image-registry-tls" not found Jul 29 22:46:56.270280 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:46:56.269939 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls podName:8a99368f-26f7-4928-a704-176d5208dad2 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:28.269928293 +0000 UTC m=+98.760694759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls") pod "image-registry-64cd5fb486-xcbcq" (UID: "8a99368f-26f7-4928-a704-176d5208dad2") : secret "image-registry-tls" not found Jul 29 22:46:58.367768 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:58.367725 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxq2f" event={"ID":"38125471-addd-487e-bea4-c00f9750ed19","Type":"ContainerStarted","Data":"e94f10e2b1557039aad72d7030a9af27a9fcf0bc3cf93960fe6b4fb5fbbafd1f"} Jul 29 22:46:58.368255 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:58.367846 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:46:58.388018 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:46:58.387956 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lxq2f" podStartSLOduration=65.531122396 podStartE2EDuration="1m8.387930341s" totalImagesPullingTime="2.856807945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:58.386254652 +0000 UTC m=+68.877021337" watchObservedRunningTime="2026-07-29 22:46:58.387930341 +0000 UTC m=+68.878696812" Jul 29 22:47:00.374538 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:00.374506 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t2fvl" event={"ID":"565ea92c-5654-4024-b67d-9e40473eb5d3","Type":"ContainerStarted","Data":"0765954a1a36c3005a1734cc4681b2076994c91f8cbe50dc1dc885b12188aa54"} Jul 29 22:47:00.396069 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:00.396014 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t2fvl" podStartSLOduration=66.010415405 podStartE2EDuration="1m10.396000881s" totalImagesPullingTime="4.385585476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:00.395821171 +0000 UTC m=+70.886587658" watchObservedRunningTime="2026-07-29 22:47:00.396000881 +0000 UTC m=+70.886767395" Jul 29 22:47:10.280513 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.280482 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-krrc9"] Jul 29 22:47:10.283051 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.283036 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.286040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.286012 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 22:47:10.286185 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.286051 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 22:47:10.286185 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.286074 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:47:10.286185 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.286053 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 22:47:10.287409 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.287389 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bl2j5\"" Jul 29 22:47:10.292191 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.292171 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 22:47:10.294942 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.294920 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-krrc9"] Jul 29 22:47:10.367892 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.367845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320be804-f6c4-4683-87f2-2da796ebdebf-trusted-ca\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.368310 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.367973 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/320be804-f6c4-4683-87f2-2da796ebdebf-config\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.368310 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.368005 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/320be804-f6c4-4683-87f2-2da796ebdebf-serving-cert\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.368310 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.368048 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn687\" (UniqueName: \"kubernetes.io/projected/320be804-f6c4-4683-87f2-2da796ebdebf-kube-api-access-nn687\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.369022 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.369002 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn"] Jul 29 22:47:10.371951 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.371936 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:10.374513 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.374494 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 22:47:10.374717 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.374702 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 22:47:10.374808 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.374790 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qqvhf\"" Jul 29 22:47:10.374868 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.374790 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:47:10.382578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.382556 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn"] Jul 29 22:47:10.468963 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.468927 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320be804-f6c4-4683-87f2-2da796ebdebf-trusted-ca\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.469173 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.468969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hn9v\" (UniqueName: \"kubernetes.io/projected/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-kube-api-access-2hn9v\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:10.469173 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.469004 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/320be804-f6c4-4683-87f2-2da796ebdebf-config\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.469173 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.469028 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/320be804-f6c4-4683-87f2-2da796ebdebf-serving-cert\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.469173 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.469055 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn687\" (UniqueName: \"kubernetes.io/projected/320be804-f6c4-4683-87f2-2da796ebdebf-kube-api-access-nn687\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.469173 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.469124 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:10.469867 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.469842 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/320be804-f6c4-4683-87f2-2da796ebdebf-config\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.470067 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.470050 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320be804-f6c4-4683-87f2-2da796ebdebf-trusted-ca\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.471297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.471280 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/320be804-f6c4-4683-87f2-2da796ebdebf-serving-cert\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.473141 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.473101 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx"] Jul 29 22:47:10.476080 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.476056 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" Jul 29 22:47:10.478896 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.478877 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gqjcj\"" Jul 29 22:47:10.485359 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.485336 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx"] Jul 29 22:47:10.487612 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.487588 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn687\" (UniqueName: \"kubernetes.io/projected/320be804-f6c4-4683-87f2-2da796ebdebf-kube-api-access-nn687\") pod \"console-operator-584dcb6b54-krrc9\" (UID: \"320be804-f6c4-4683-87f2-2da796ebdebf\") " pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.570057 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.569971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jvsx\" (UniqueName: \"kubernetes.io/projected/f9244074-142c-405c-bd2e-bb37f98936bb-kube-api-access-9jvsx\") pod \"network-check-source-7d88cb55d8-7vjfx\" (UID: \"f9244074-142c-405c-bd2e-bb37f98936bb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" Jul 29 22:47:10.570057 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.570012 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hn9v\" (UniqueName: \"kubernetes.io/projected/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-kube-api-access-2hn9v\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:10.570278 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.570077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:10.570278 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:10.570188 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 22:47:10.570278 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:10.570237 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls podName:8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:11.07022284 +0000 UTC m=+81.560989303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls") pod "cluster-samples-operator-6748489656-q62tn" (UID: "8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6") : secret "samples-operator-tls" not found Jul 29 22:47:10.580014 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.579988 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hn9v\" (UniqueName: \"kubernetes.io/projected/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-kube-api-access-2hn9v\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:10.592838 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.592817 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:10.670551 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.670523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jvsx\" (UniqueName: \"kubernetes.io/projected/f9244074-142c-405c-bd2e-bb37f98936bb-kube-api-access-9jvsx\") pod \"network-check-source-7d88cb55d8-7vjfx\" (UID: \"f9244074-142c-405c-bd2e-bb37f98936bb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" Jul 29 22:47:10.683296 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.683269 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jvsx\" (UniqueName: \"kubernetes.io/projected/f9244074-142c-405c-bd2e-bb37f98936bb-kube-api-access-9jvsx\") pod \"network-check-source-7d88cb55d8-7vjfx\" (UID: \"f9244074-142c-405c-bd2e-bb37f98936bb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" Jul 29 22:47:10.716577 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.716547 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-krrc9"] Jul 29 22:47:10.719652 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:10.719616 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320be804_f6c4_4683_87f2_2da796ebdebf.slice/crio-f2715c801d27e9d626709815faaba67c7a502747303b932dc125981de9ab6c65 WatchSource:0}: Error finding container f2715c801d27e9d626709815faaba67c7a502747303b932dc125981de9ab6c65: Status 404 returned error can't find the container with id f2715c801d27e9d626709815faaba67c7a502747303b932dc125981de9ab6c65 Jul 29 22:47:10.784041 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.784016 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" Jul 29 22:47:10.904729 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:10.904698 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx"] Jul 29 22:47:10.907357 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:10.907329 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9244074_142c_405c_bd2e_bb37f98936bb.slice/crio-214db74134723a0536c812c067bb0e53470770c18b0d9a94c0ed8a562644a0fa WatchSource:0}: Error finding container 214db74134723a0536c812c067bb0e53470770c18b0d9a94c0ed8a562644a0fa: Status 404 returned error can't find the container with id 214db74134723a0536c812c067bb0e53470770c18b0d9a94c0ed8a562644a0fa Jul 29 22:47:11.074590 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:11.074547 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:11.074781 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:11.074666 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 22:47:11.074781 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:11.074727 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls podName:8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:12.074708734 +0000 UTC m=+82.565475197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls") pod "cluster-samples-operator-6748489656-q62tn" (UID: "8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6") : secret "samples-operator-tls" not found Jul 29 22:47:11.405821 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:11.405476 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" event={"ID":"f9244074-142c-405c-bd2e-bb37f98936bb","Type":"ContainerStarted","Data":"b413ca2aeaed18c7c5ffaca0a4fb2b5164b59d0e6aabc9060b696520987a4892"} Jul 29 22:47:11.405821 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:11.405567 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" event={"ID":"f9244074-142c-405c-bd2e-bb37f98936bb","Type":"ContainerStarted","Data":"214db74134723a0536c812c067bb0e53470770c18b0d9a94c0ed8a562644a0fa"} Jul 29 22:47:11.406805 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:11.406783 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" event={"ID":"320be804-f6c4-4683-87f2-2da796ebdebf","Type":"ContainerStarted","Data":"f2715c801d27e9d626709815faaba67c7a502747303b932dc125981de9ab6c65"} Jul 29 22:47:11.424452 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:11.424400 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-7vjfx" podStartSLOduration=1.424382942 podStartE2EDuration="1.424382942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:11.423003441 +0000 UTC m=+81.913769926" watchObservedRunningTime="2026-07-29 22:47:11.424382942 +0000 UTC m=+81.915149428" Jul 29 22:47:12.083694 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:12.082548 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:12.083694 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:12.082726 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 22:47:12.083694 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:12.082779 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls podName:8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.082765551 +0000 UTC m=+84.573532016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls") pod "cluster-samples-operator-6748489656-q62tn" (UID: "8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6") : secret "samples-operator-tls" not found Jul 29 22:47:13.192839 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.192806 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vxzb4"] Jul 29 22:47:13.195865 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.195849 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.206383 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.206364 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 22:47:13.208375 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.208357 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 22:47:13.221652 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.221631 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 22:47:13.221743 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.221633 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p4nhh\"" Jul 29 22:47:13.221883 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.221871 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 22:47:13.242930 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.242896 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vxzb4"] Jul 29 22:47:13.292153 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.292101 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.292153 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.292153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-crio-socket\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.292343 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.292208 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-data-volume\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.292343 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.292245 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.292343 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.292270 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxwc\" (UniqueName: \"kubernetes.io/projected/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-api-access-lpxwc\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393228 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393228 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393231 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-crio-socket\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393250 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-data-volume\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393267 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393286 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxwc\" (UniqueName: \"kubernetes.io/projected/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-api-access-lpxwc\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.393345 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.393401 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.393429 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:13.893409428 +0000 UTC m=+84.384175891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : configmap "kube-rbac-proxy" not found Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393351 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-crio-socket\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.393463 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.393460 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:13.893440267 +0000 UTC m=+84.384206730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.393774 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.393587 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-data-volume\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.412669 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.412645 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/0.log" Jul 29 22:47:13.412805 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.412680 2569 generic.go:356] "Generic (PLEG): container finished" podID="320be804-f6c4-4683-87f2-2da796ebdebf" containerID="248e9db6a0e7569a3c3bae17d5215d7df2ecf46c18ebd840f2e0da65d0291d5c" exitCode=255 Jul 29 22:47:13.412805 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.412716 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" event={"ID":"320be804-f6c4-4683-87f2-2da796ebdebf","Type":"ContainerDied","Data":"248e9db6a0e7569a3c3bae17d5215d7df2ecf46c18ebd840f2e0da65d0291d5c"} Jul 29 22:47:13.412948 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.412933 2569 scope.go:117] "RemoveContainer" containerID="248e9db6a0e7569a3c3bae17d5215d7df2ecf46c18ebd840f2e0da65d0291d5c" Jul 29 22:47:13.413364 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.413346 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxwc\" (UniqueName: \"kubernetes.io/projected/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-api-access-lpxwc\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.897822 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.897773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.898014 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:13.897835 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:13.898014 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.897908 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:13.898014 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.897985 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.897969747 +0000 UTC m=+85.388736210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : configmap "kube-rbac-proxy" not found Jul 29 22:47:13.898014 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.898001 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.898198 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:13.898053 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.898036983 +0000 UTC m=+85.388803446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:14.100457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.100409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:14.100658 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.100582 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 22:47:14.100719 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.100663 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls podName:8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.100643743 +0000 UTC m=+88.591410206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls") pod "cluster-samples-operator-6748489656-q62tn" (UID: "8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6") : secret "samples-operator-tls" not found Jul 29 22:47:14.416851 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.416822 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/1.log" Jul 29 22:47:14.417287 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.417222 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/0.log" Jul 29 22:47:14.417287 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.417251 2569 generic.go:356] "Generic (PLEG): container finished" podID="320be804-f6c4-4683-87f2-2da796ebdebf" containerID="d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9" exitCode=255 Jul 29 22:47:14.417287 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.417277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" event={"ID":"320be804-f6c4-4683-87f2-2da796ebdebf","Type":"ContainerDied","Data":"d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9"} Jul 29 22:47:14.417395 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.417315 2569 scope.go:117] "RemoveContainer" containerID="248e9db6a0e7569a3c3bae17d5215d7df2ecf46c18ebd840f2e0da65d0291d5c" Jul 29 22:47:14.417554 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.417535 2569 scope.go:117] "RemoveContainer" containerID="d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9" Jul 29 22:47:14.417717 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.417698 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-krrc9_openshift-console-operator(320be804-f6c4-4683-87f2-2da796ebdebf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" podUID="320be804-f6c4-4683-87f2-2da796ebdebf" Jul 29 22:47:14.906265 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.906218 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:14.906434 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:14.906294 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:14.906434 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.906342 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:14.906434 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.906413 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:16.906395156 +0000 UTC m=+87.397161620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : configmap "kube-rbac-proxy" not found Jul 29 22:47:14.906434 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.906413 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:14.906565 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:14.906447 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:16.906439323 +0000 UTC m=+87.397205787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:15.179574 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:15.179499 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm4l8_bf3ac0df-73b0-4012-8826-271ed3cb70aa/dns-node-resolver/0.log" Jul 29 22:47:15.420940 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:15.420911 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/1.log" Jul 29 22:47:15.421301 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:15.421237 2569 scope.go:117] "RemoveContainer" containerID="d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9" Jul 29 22:47:15.421386 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:15.421368 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-krrc9_openshift-console-operator(320be804-f6c4-4683-87f2-2da796ebdebf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" podUID="320be804-f6c4-4683-87f2-2da796ebdebf" Jul 29 22:47:15.977809 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:15.977784 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wvgb_eb643171-ab1a-4b6d-89d9-9dac9c5a493b/node-ca/0.log" Jul 29 22:47:16.920762 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:16.920725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:16.920762 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:16.920763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:16.921185 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:16.920868 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:16.921185 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:16.920871 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:16.921185 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:16.920921 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:20.920908251 +0000 UTC m=+91.411674715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:16.921185 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:16.920937 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:20.920929322 +0000 UTC m=+91.411695785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : configmap "kube-rbac-proxy" not found Jul 29 22:47:16.985412 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:16.985386 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqmnm_3d476d7f-1f21-4302-990e-42abb089d203/serve-healthcheck-canary/0.log" Jul 29 22:47:18.127331 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:18.127297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:18.127690 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:18.127451 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 22:47:18.127690 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:18.127513 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls podName:8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:26.127494683 +0000 UTC m=+96.618261157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls") pod "cluster-samples-operator-6748489656-q62tn" (UID: "8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6") : secret "samples-operator-tls" not found Jul 29 22:47:20.593318 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:20.593283 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:20.593716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:20.593368 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:20.593716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:20.593683 2569 scope.go:117] "RemoveContainer" containerID="d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9" Jul 29 22:47:20.593861 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:20.593839 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-krrc9_openshift-console-operator(320be804-f6c4-4683-87f2-2da796ebdebf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" podUID="320be804-f6c4-4683-87f2-2da796ebdebf" Jul 29 22:47:20.949541 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:20.949450 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:20.949541 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:20.949499 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:20.949766 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:20.949573 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:20.949766 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:20.949605 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:20.949766 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:20.949649 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:28.949633647 +0000 UTC m=+99.440400110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : configmap "kube-rbac-proxy" not found Jul 29 22:47:20.949766 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:20.949663 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:28.949657495 +0000 UTC m=+99.440423957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:26.189304 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:26.189254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:26.191582 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:26.191564 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-q62tn\" (UID: \"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:26.280545 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:26.280490 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" Jul 29 22:47:26.406146 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:26.406098 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn"] Jul 29 22:47:27.451046 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:27.451010 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" event={"ID":"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6","Type":"ContainerStarted","Data":"d5c2364131afa8f1951c3b0603d1527b1a94308ec36ac30f89bf1b7b3892d024"} Jul 29 22:47:28.306766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.306738 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:47:28.306884 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.306852 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:47:28.309450 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.309427 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"image-registry-64cd5fb486-xcbcq\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:47:28.309581 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.309517 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ec08b6-cb98-4382-ab3e-15cabb772d5b-metrics-tls\") pod \"dns-default-dnwls\" (UID: \"54ec08b6-cb98-4382-ab3e-15cabb772d5b\") " pod="openshift-dns/dns-default-dnwls" Jul 29 22:47:28.457348 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.457261 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" event={"ID":"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6","Type":"ContainerStarted","Data":"c4c8d95f379d73469e91b00913570483a80aea70cd2a901006e7322346fb0e2c"} Jul 29 22:47:28.457348 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.457312 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" event={"ID":"8f9e0cd7-898e-4040-a2fc-ecec2cdea2f6","Type":"ContainerStarted","Data":"c6cea0fffbbf2fbff079802d3fb0c29d03f873ecb2ee5085485593f5e5303b2d"} Jul 29 22:47:28.477192 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.477143 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-q62tn" podStartSLOduration=16.742070683 podStartE2EDuration="18.477128492s" totalImagesPullingTime="1.735057809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:28.47646063 +0000 UTC m=+98.967227115" watchObservedRunningTime="2026-07-29 22:47:28.477128492 +0000 UTC m=+98.967894971" Jul 29 22:47:28.594728 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.594693 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwgrj\"" Jul 29 22:47:28.602214 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.602192 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:47:28.605761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.605743 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lczg\"" Jul 29 22:47:28.614113 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.614082 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dnwls" Jul 29 22:47:28.734568 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.734424 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64cd5fb486-xcbcq"] Jul 29 22:47:28.736994 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:28.736965 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a99368f_26f7_4928_a704_176d5208dad2.slice/crio-972a584f152448e82656ccc5c7e792e5c5c5edc19b66215d3340e316eb3908c4 WatchSource:0}: Error finding container 972a584f152448e82656ccc5c7e792e5c5c5edc19b66215d3340e316eb3908c4: Status 404 returned error can't find the container with id 972a584f152448e82656ccc5c7e792e5c5c5edc19b66215d3340e316eb3908c4 Jul 29 22:47:28.749696 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:28.749669 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dnwls"] Jul 29 22:47:28.752272 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:28.752247 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ec08b6_cb98_4382_ab3e_15cabb772d5b.slice/crio-8c8cf396257e16ac5510c7d385d3a24080df3caee66d289a4119220c614b493a WatchSource:0}: Error finding container 8c8cf396257e16ac5510c7d385d3a24080df3caee66d289a4119220c614b493a: Status 404 returned error can't find the container with id 8c8cf396257e16ac5510c7d385d3a24080df3caee66d289a4119220c614b493a Jul 29 22:47:29.012827 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.012723 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:29.012827 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.012780 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:29.013054 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:29.012949 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:29.013054 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:29.013017 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls podName:6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac nodeName:}" failed. No retries permitted until 2026-07-29 22:47:45.013002301 +0000 UTC m=+115.503768764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxzb4" (UID: "6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:29.013357 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.013336 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:29.373538 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.373507 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lxq2f" Jul 29 22:47:29.462349 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.462313 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dnwls" event={"ID":"54ec08b6-cb98-4382-ab3e-15cabb772d5b","Type":"ContainerStarted","Data":"8c8cf396257e16ac5510c7d385d3a24080df3caee66d289a4119220c614b493a"} Jul 29 22:47:29.464038 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.464003 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" event={"ID":"8a99368f-26f7-4928-a704-176d5208dad2","Type":"ContainerStarted","Data":"5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429"} Jul 29 22:47:29.464186 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.464058 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" event={"ID":"8a99368f-26f7-4928-a704-176d5208dad2","Type":"ContainerStarted","Data":"972a584f152448e82656ccc5c7e792e5c5c5edc19b66215d3340e316eb3908c4"} Jul 29 22:47:29.488813 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:29.488605 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" podStartSLOduration=98.488584035 podStartE2EDuration="1m38.488584035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:29.487772529 +0000 UTC m=+99.978539015" watchObservedRunningTime="2026-07-29 22:47:29.488584035 +0000 UTC m=+99.979350522" Jul 29 22:47:30.466820 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:30.466798 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:47:30.920167 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:30.920131 2569 scope.go:117] "RemoveContainer" containerID="d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9" Jul 29 22:47:31.471885 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.471856 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dnwls" event={"ID":"54ec08b6-cb98-4382-ab3e-15cabb772d5b","Type":"ContainerStarted","Data":"f03953fe0fa3a0d0cd7f530d527517ba360982c1c0a6e590c059d178518502dd"} Jul 29 22:47:31.472345 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.471913 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dnwls" event={"ID":"54ec08b6-cb98-4382-ab3e-15cabb772d5b","Type":"ContainerStarted","Data":"82e5fcee67b343d7ab66b1b04c1ee07e73797ef13099386d1adc51045809543b"} Jul 29 22:47:31.472345 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.471959 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dnwls" Jul 29 22:47:31.473376 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.473360 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 22:47:31.473727 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.473712 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/1.log" Jul 29 22:47:31.473802 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.473741 2569 generic.go:356] "Generic (PLEG): container finished" podID="320be804-f6c4-4683-87f2-2da796ebdebf" containerID="a9d1de4dab7599d8c6e66b4283f1a4752d0d680a34aaffe99f031fd25f44fcc9" exitCode=255 Jul 29 22:47:31.473838 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.473818 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" event={"ID":"320be804-f6c4-4683-87f2-2da796ebdebf","Type":"ContainerDied","Data":"a9d1de4dab7599d8c6e66b4283f1a4752d0d680a34aaffe99f031fd25f44fcc9"} Jul 29 22:47:31.473871 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.473858 2569 scope.go:117] "RemoveContainer" containerID="d617339d3a7e3931cb03361a63855157a08af75033cffebd62d29fc707705ce9" Jul 29 22:47:31.474175 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.474160 2569 scope.go:117] "RemoveContainer" containerID="a9d1de4dab7599d8c6e66b4283f1a4752d0d680a34aaffe99f031fd25f44fcc9" Jul 29 22:47:31.474349 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:31.474327 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-krrc9_openshift-console-operator(320be804-f6c4-4683-87f2-2da796ebdebf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" podUID="320be804-f6c4-4683-87f2-2da796ebdebf" Jul 29 22:47:31.492455 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:31.492419 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dnwls" podStartSLOduration=65.784359487 podStartE2EDuration="1m7.492407878s" totalImagesPullingTime="1.708048391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:31.492195626 +0000 UTC m=+101.982962112" watchObservedRunningTime="2026-07-29 22:47:31.492407878 +0000 UTC m=+101.983174360" Jul 29 22:47:32.479137 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:32.479088 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 22:47:36.649032 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.649000 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv"] Jul 29 22:47:36.651946 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.651928 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.655782 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.655762 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 22:47:36.656075 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.656059 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 22:47:36.656241 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.656228 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 22:47:36.657235 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.657219 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 22:47:36.666264 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.666243 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv"] Jul 29 22:47:36.771585 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.771556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdh9x\" (UniqueName: \"kubernetes.io/projected/46363b7a-b245-4b74-a1cb-8945ae401331-kube-api-access-fdh9x\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.771748 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.771611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46363b7a-b245-4b74-a1cb-8945ae401331-tmp\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.771748 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.771671 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46363b7a-b245-4b74-a1cb-8945ae401331-klusterlet-config\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.872739 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.872687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46363b7a-b245-4b74-a1cb-8945ae401331-tmp\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.872938 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.872750 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46363b7a-b245-4b74-a1cb-8945ae401331-klusterlet-config\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.872938 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.872814 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdh9x\" (UniqueName: \"kubernetes.io/projected/46363b7a-b245-4b74-a1cb-8945ae401331-kube-api-access-fdh9x\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.873194 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.873176 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46363b7a-b245-4b74-a1cb-8945ae401331-tmp\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.875209 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.875190 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46363b7a-b245-4b74-a1cb-8945ae401331-klusterlet-config\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.881788 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.881766 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdh9x\" (UniqueName: \"kubernetes.io/projected/46363b7a-b245-4b74-a1cb-8945ae401331-kube-api-access-fdh9x\") pod \"klusterlet-addon-workmgr-68b75c5497-gcwsv\" (UID: \"46363b7a-b245-4b74-a1cb-8945ae401331\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:36.960517 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:36.960436 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:37.080285 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:37.080257 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv"] Jul 29 22:47:37.083050 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:37.083018 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46363b7a_b245_4b74_a1cb_8945ae401331.slice/crio-4a6169c43c960307d87b46f53a218d65a4eacc79954f3d1b132c9dda3992e7fe WatchSource:0}: Error finding container 4a6169c43c960307d87b46f53a218d65a4eacc79954f3d1b132c9dda3992e7fe: Status 404 returned error can't find the container with id 4a6169c43c960307d87b46f53a218d65a4eacc79954f3d1b132c9dda3992e7fe Jul 29 22:47:37.498851 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:37.498810 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" event={"ID":"46363b7a-b245-4b74-a1cb-8945ae401331","Type":"ContainerStarted","Data":"4a6169c43c960307d87b46f53a218d65a4eacc79954f3d1b132c9dda3992e7fe"} Jul 29 22:47:40.593127 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:40.593083 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:40.593573 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:40.593153 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:40.593573 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:40.593491 2569 scope.go:117] "RemoveContainer" containerID="a9d1de4dab7599d8c6e66b4283f1a4752d0d680a34aaffe99f031fd25f44fcc9" Jul 29 22:47:40.593688 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:40.593642 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-krrc9_openshift-console-operator(320be804-f6c4-4683-87f2-2da796ebdebf)\"" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" podUID="320be804-f6c4-4683-87f2-2da796ebdebf" Jul 29 22:47:41.482031 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:41.482001 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dnwls" Jul 29 22:47:41.514832 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:41.514799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" event={"ID":"46363b7a-b245-4b74-a1cb-8945ae401331","Type":"ContainerStarted","Data":"b6c65539cef5ec78301adb279a03ade97946f3cbfcd511e9ef9b4364d870da72"} Jul 29 22:47:41.515038 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:41.515019 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:41.516529 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:41.516507 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" Jul 29 22:47:41.532872 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:41.532829 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b75c5497-gcwsv" podStartSLOduration=1.548386628 podStartE2EDuration="5.532814985s" totalImagesPullingTime="3.984428357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:41.532525664 +0000 UTC m=+112.023292153" watchObservedRunningTime="2026-07-29 22:47:41.532814985 +0000 UTC m=+112.023581469" Jul 29 22:47:44.516730 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.516693 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk"] Jul 29 22:47:44.519773 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.519755 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:44.522581 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.522552 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 22:47:44.522731 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.522712 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-twdjg\"" Jul 29 22:47:44.529127 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.529091 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk"] Jul 29 22:47:44.636008 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.635962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-22rdk\" (UID: \"47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:44.737237 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:44.737207 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-22rdk\" (UID: \"47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:44.737370 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:44.737352 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 29 22:47:44.737419 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:44.737412 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978-tls-certificates podName:47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:45.237398789 +0000 UTC m=+115.728165255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-22rdk" (UID: "47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978") : secret "prometheus-operator-admission-webhook-tls" not found Jul 29 22:47:45.038664 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.038622 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:45.040885 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.040864 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxzb4\" (UID: \"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac\") " pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:45.239930 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.239898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-22rdk\" (UID: \"47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:45.242245 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.242216 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-22rdk\" (UID: \"47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:45.304053 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.303941 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vxzb4" Jul 29 22:47:45.429276 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.429245 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:45.432491 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.432471 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vxzb4"] Jul 29 22:47:45.434856 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:45.434826 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6c1ecc_98f9_4ead_8f23_1bbcab0567ac.slice/crio-c91becb878ccd7138048f48fadb0eb77c35f41a5c764affdd4b86eade496d553 WatchSource:0}: Error finding container c91becb878ccd7138048f48fadb0eb77c35f41a5c764affdd4b86eade496d553: Status 404 returned error can't find the container with id c91becb878ccd7138048f48fadb0eb77c35f41a5c764affdd4b86eade496d553 Jul 29 22:47:45.529477 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.529431 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxzb4" event={"ID":"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac","Type":"ContainerStarted","Data":"c91becb878ccd7138048f48fadb0eb77c35f41a5c764affdd4b86eade496d553"} Jul 29 22:47:45.571209 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:45.571122 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk"] Jul 29 22:47:45.575201 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:45.575166 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ea43b1_10ce_4af7_b3d9_f3b7d2cd9978.slice/crio-3522f73c2d237dd6c8aefa96db603d94b1c38cc88fb8784a94d1368245ff3a83 WatchSource:0}: Error finding container 3522f73c2d237dd6c8aefa96db603d94b1c38cc88fb8784a94d1368245ff3a83: Status 404 returned error can't find the container with id 3522f73c2d237dd6c8aefa96db603d94b1c38cc88fb8784a94d1368245ff3a83 Jul 29 22:47:46.535715 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:46.535676 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" event={"ID":"47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978","Type":"ContainerStarted","Data":"3522f73c2d237dd6c8aefa96db603d94b1c38cc88fb8784a94d1368245ff3a83"} Jul 29 22:47:47.540778 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:47.540745 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" event={"ID":"47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978","Type":"ContainerStarted","Data":"c3fcca13f853aab5c779fdcd182bca8663eb68bd127ee71b97ac67fc38f2b141"} Jul 29 22:47:47.541213 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:47.540916 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:47.546216 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:47.546187 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" Jul 29 22:47:47.559006 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:47.558964 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-22rdk" podStartSLOduration=2.402068597 podStartE2EDuration="3.558948375s" totalImagesPullingTime="1.156879778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:47.557839866 +0000 UTC m=+118.048606351" watchObservedRunningTime="2026-07-29 22:47:47.558948375 +0000 UTC m=+118.049714860" Jul 29 22:47:48.607888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:48.607842 2569 patch_prober.go:28] interesting pod/image-registry-64cd5fb486-xcbcq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 22:47:48.608377 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:48.607916 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" podUID="8a99368f-26f7-4928-a704-176d5208dad2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 22:47:50.552792 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:50.552708 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxzb4" event={"ID":"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac","Type":"ContainerStarted","Data":"3ae2b0872da35a29967039cf0bdb2518c1042ef11f1c9160a4ce6a8604ad7fa2"} Jul 29 22:47:51.479519 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:51.479485 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:47:52.919874 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:52.919846 2569 scope.go:117] "RemoveContainer" containerID="a9d1de4dab7599d8c6e66b4283f1a4752d0d680a34aaffe99f031fd25f44fcc9" Jul 29 22:47:53.979392 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.979311 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz"] Jul 29 22:47:53.982552 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.982531 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:53.985187 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.985161 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 22:47:53.985295 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.985231 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 22:47:53.985399 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.985375 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 22:47:53.985510 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.985399 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 22:47:53.986381 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.986362 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 22:47:53.986452 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.986362 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fzxdb\"" Jul 29 22:47:53.992509 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.992489 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v"] Jul 29 22:47:53.995510 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.995491 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz"] Jul 29 22:47:53.995622 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.995610 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:53.997966 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.997948 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 22:47:53.998066 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.998012 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jbh2f\"" Jul 29 22:47:53.998161 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.998146 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 22:47:53.998215 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:53.998173 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 22:47:54.004597 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.004579 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tdgsf"] Jul 29 22:47:54.009456 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.009382 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.012332 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.012320 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 22:47:54.012448 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.012429 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vdx2\"" Jul 29 22:47:54.012535 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.012440 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 22:47:54.012535 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.012449 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 22:47:54.016494 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.016235 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v"] Jul 29 22:47:54.115279 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-textfile\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115285 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-root\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115355 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22gjz\" (UniqueName: \"kubernetes.io/projected/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-kube-api-access-22gjz\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.115436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115378 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66854a91-0aeb-4742-8d6b-03acb4b90420-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.115436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115400 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.115436 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.115620 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115474 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6jj6\" (UniqueName: \"kubernetes.io/projected/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-api-access-m6jj6\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.115620 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsgfx\" (UniqueName: \"kubernetes.io/projected/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-kube-api-access-fsgfx\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115620 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.115620 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.115620 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.115760 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115632 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/66854a91-0aeb-4742-8d6b-03acb4b90420-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.115760 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115676 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.115760 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115695 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-metrics-client-ca\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115760 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-tls\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115760 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-wtmp\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115900 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.115900 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.115802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-sys\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.217178 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217137 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22gjz\" (UniqueName: \"kubernetes.io/projected/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-kube-api-access-22gjz\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.217345 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217184 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66854a91-0aeb-4742-8d6b-03acb4b90420-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.217345 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.217345 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217243 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.217345 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217271 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6jj6\" (UniqueName: \"kubernetes.io/projected/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-api-access-m6jj6\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.217589 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217568 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsgfx\" (UniqueName: \"kubernetes.io/projected/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-kube-api-access-fsgfx\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.217638 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.217692 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217638 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.217692 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.217790 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217704 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/66854a91-0aeb-4742-8d6b-03acb4b90420-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.217790 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.217790 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-metrics-client-ca\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.217790 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217765 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-tls\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217794 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-wtmp\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217809 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217830 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-sys\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217855 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-textfile\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217877 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-root\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.217893 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:54.217956 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 22:47:54.218013 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218000 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66854a91-0aeb-4742-8d6b-03acb4b90420-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.218427 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:47:54.218036 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-tls podName:c1f9ff41-6d04-43d8-a6fd-c14b664a0290 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:54.718016304 +0000 UTC m=+125.208782767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-tls") pod "node-exporter-tdgsf" (UID: "c1f9ff41-6d04-43d8-a6fd-c14b664a0290") : secret "node-exporter-tls" not found Jul 29 22:47:54.218427 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218318 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/66854a91-0aeb-4742-8d6b-03acb4b90420-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.218427 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218353 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.218427 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218418 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-sys\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218701 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218513 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218701 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218533 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-wtmp\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218832 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218789 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-textfile\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-root\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.218973 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.218881 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-metrics-client-ca\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.219158 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.219089 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.220568 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.220539 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.221047 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.221024 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.221047 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.221037 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.221802 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.221781 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.221886 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.221801 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.226432 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.226410 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22gjz\" (UniqueName: \"kubernetes.io/projected/9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d-kube-api-access-22gjz\") pod \"openshift-state-metrics-b8f49f5c6-ctzxz\" (UID: \"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.226655 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.226632 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6jj6\" (UniqueName: \"kubernetes.io/projected/66854a91-0aeb-4742-8d6b-03acb4b90420-kube-api-access-m6jj6\") pod \"kube-state-metrics-56d9f944b4-b4d5v\" (UID: \"66854a91-0aeb-4742-8d6b-03acb4b90420\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.226862 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.226840 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsgfx\" (UniqueName: \"kubernetes.io/projected/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-kube-api-access-fsgfx\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.293614 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.293528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" Jul 29 22:47:54.305728 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.305525 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" Jul 29 22:47:54.341402 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.341368 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-hd8d8"] Jul 29 22:47:54.345838 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.345816 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:47:54.349181 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.349092 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jsw4k\"" Jul 29 22:47:54.349566 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.349543 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 22:47:54.349769 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.349750 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 22:47:54.357466 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.355826 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-hd8d8"] Jul 29 22:47:54.467510 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.467477 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz"] Jul 29 22:47:54.470986 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:54.470948 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9480c7f2_fd2f_4aa8_9001_0c25f8c59a3d.slice/crio-2abaee3681779a38a06bdeba6ecc1d6a1c71d4d894de1d0eda2ae7de2f4fd03a WatchSource:0}: Error finding container 2abaee3681779a38a06bdeba6ecc1d6a1c71d4d894de1d0eda2ae7de2f4fd03a: Status 404 returned error can't find the container with id 2abaee3681779a38a06bdeba6ecc1d6a1c71d4d894de1d0eda2ae7de2f4fd03a Jul 29 22:47:54.489594 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.489562 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v"] Jul 29 22:47:54.502159 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:54.502131 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66854a91_0aeb_4742_8d6b_03acb4b90420.slice/crio-f075f969fbfa364acdd3253d2242ba2671073bbd48e99f39667f8e50014ad5fe WatchSource:0}: Error finding container f075f969fbfa364acdd3253d2242ba2671073bbd48e99f39667f8e50014ad5fe: Status 404 returned error can't find the container with id f075f969fbfa364acdd3253d2242ba2671073bbd48e99f39667f8e50014ad5fe Jul 29 22:47:54.519988 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.519950 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l7s7\" (UniqueName: \"kubernetes.io/projected/a70466f3-9119-4c9d-b45f-f30e0d41a820-kube-api-access-9l7s7\") pod \"downloads-7c97dc4555-hd8d8\" (UID: \"a70466f3-9119-4c9d-b45f-f30e0d41a820\") " pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:47:54.570342 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.570319 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 22:47:54.570466 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.570406 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" event={"ID":"320be804-f6c4-4683-87f2-2da796ebdebf","Type":"ContainerStarted","Data":"88080301f0e4a6d45ff3cddd26a715e465efec3c85b34f0c937011d3216940b0"} Jul 29 22:47:54.570733 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.570673 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:54.573504 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.573477 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" event={"ID":"66854a91-0aeb-4742-8d6b-03acb4b90420","Type":"ContainerStarted","Data":"f075f969fbfa364acdd3253d2242ba2671073bbd48e99f39667f8e50014ad5fe"} Jul 29 22:47:54.576096 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.576067 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxzb4" event={"ID":"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac","Type":"ContainerStarted","Data":"5f7fcaa651b32f146d7dfe1a6d545e8e11614c9e48d4bed77f23c5173606e0a4"} Jul 29 22:47:54.576594 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.576544 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" Jul 29 22:47:54.578310 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.578287 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" event={"ID":"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d","Type":"ContainerStarted","Data":"0913fb1cd8c026c7c7b8d3397c3e53d4d0fbb58113a1a0236efb9c43aa1c17e9"} Jul 29 22:47:54.578404 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.578337 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" event={"ID":"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d","Type":"ContainerStarted","Data":"2abaee3681779a38a06bdeba6ecc1d6a1c71d4d894de1d0eda2ae7de2f4fd03a"} Jul 29 22:47:54.597930 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.597845 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-krrc9" podStartSLOduration=42.732520704 podStartE2EDuration="44.597825497s" totalImagesPullingTime="1.865304793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:54.597227214 +0000 UTC m=+125.087993701" watchObservedRunningTime="2026-07-29 22:47:54.597825497 +0000 UTC m=+125.088591981" Jul 29 22:47:54.620644 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.620616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l7s7\" (UniqueName: \"kubernetes.io/projected/a70466f3-9119-4c9d-b45f-f30e0d41a820-kube-api-access-9l7s7\") pod \"downloads-7c97dc4555-hd8d8\" (UID: \"a70466f3-9119-4c9d-b45f-f30e0d41a820\") " pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:47:54.637370 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.637314 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l7s7\" (UniqueName: \"kubernetes.io/projected/a70466f3-9119-4c9d-b45f-f30e0d41a820-kube-api-access-9l7s7\") pod \"downloads-7c97dc4555-hd8d8\" (UID: \"a70466f3-9119-4c9d-b45f-f30e0d41a820\") " pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:47:54.660863 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.660829 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:47:54.721523 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.721491 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-tls\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.724504 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.724434 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1f9ff41-6d04-43d8-a6fd-c14b664a0290-node-exporter-tls\") pod \"node-exporter-tdgsf\" (UID: \"c1f9ff41-6d04-43d8-a6fd-c14b664a0290\") " pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.813809 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.813781 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-hd8d8"] Jul 29 22:47:54.816695 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:54.816669 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70466f3_9119_4c9d_b45f_f30e0d41a820.slice/crio-fa5b4e88007ab7cd992a4cb75cbb65d4bc3fc2ecb799f0f588be841714f0aa37 WatchSource:0}: Error finding container fa5b4e88007ab7cd992a4cb75cbb65d4bc3fc2ecb799f0f588be841714f0aa37: Status 404 returned error can't find the container with id fa5b4e88007ab7cd992a4cb75cbb65d4bc3fc2ecb799f0f588be841714f0aa37 Jul 29 22:47:54.919406 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:54.919372 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tdgsf" Jul 29 22:47:54.935471 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:54.935421 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f9ff41_6d04_43d8_a6fd_c14b664a0290.slice/crio-fa2f3fb3300a7302fb7d097800323896606903986ab8b788f22cde61da7d5f24 WatchSource:0}: Error finding container fa2f3fb3300a7302fb7d097800323896606903986ab8b788f22cde61da7d5f24: Status 404 returned error can't find the container with id fa2f3fb3300a7302fb7d097800323896606903986ab8b788f22cde61da7d5f24 Jul 29 22:47:55.586046 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:55.585962 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-hd8d8" event={"ID":"a70466f3-9119-4c9d-b45f-f30e0d41a820","Type":"ContainerStarted","Data":"fa5b4e88007ab7cd992a4cb75cbb65d4bc3fc2ecb799f0f588be841714f0aa37"} Jul 29 22:47:55.589408 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:55.589323 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" event={"ID":"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d","Type":"ContainerStarted","Data":"61a847aac93baac3350740dd701e9dd69b716f076d9472e1383acff8f6367281"} Jul 29 22:47:55.591126 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:55.591070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdgsf" event={"ID":"c1f9ff41-6d04-43d8-a6fd-c14b664a0290","Type":"ContainerStarted","Data":"fa2f3fb3300a7302fb7d097800323896606903986ab8b788f22cde61da7d5f24"} Jul 29 22:47:56.141154 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.140127 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78c4bfcddd-8578k"] Jul 29 22:47:56.161166 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.157741 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78c4bfcddd-8578k"] Jul 29 22:47:56.161166 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.157881 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162080 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jrrjm\"" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162150 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162345 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162385 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162345 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162574 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 22:47:56.163803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.162683 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8tu3qbmm3hdmd\"" Jul 29 22:47:56.235273 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235240 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b05663a9-a8b4-4f31-97b0-65bf78322dba-metrics-client-ca\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235273 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-grpc-tls\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235526 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235526 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235526 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-tls\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235526 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235443 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7s2\" (UniqueName: \"kubernetes.io/projected/b05663a9-a8b4-4f31-97b0-65bf78322dba-kube-api-access-ps7s2\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235526 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235489 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.235526 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.235520 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336555 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7s2\" (UniqueName: \"kubernetes.io/projected/b05663a9-a8b4-4f31-97b0-65bf78322dba-kube-api-access-ps7s2\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336745 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336570 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336745 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336745 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336677 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b05663a9-a8b4-4f31-97b0-65bf78322dba-metrics-client-ca\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336745 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336707 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-grpc-tls\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336933 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336758 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336933 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336787 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.336933 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.336845 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-tls\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.338054 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.337652 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b05663a9-a8b4-4f31-97b0-65bf78322dba-metrics-client-ca\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.339972 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.339941 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-tls\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.340933 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.340910 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-grpc-tls\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.341805 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.341315 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.341805 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.341767 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.342409 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.342376 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.343063 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.343034 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b05663a9-a8b4-4f31-97b0-65bf78322dba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.351416 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.351366 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7s2\" (UniqueName: \"kubernetes.io/projected/b05663a9-a8b4-4f31-97b0-65bf78322dba-kube-api-access-ps7s2\") pod \"thanos-querier-78c4bfcddd-8578k\" (UID: \"b05663a9-a8b4-4f31-97b0-65bf78322dba\") " pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:56.472308 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:56.472212 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:47:58.765320 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:58.765078 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78c4bfcddd-8578k"] Jul 29 22:47:58.768995 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:58.768851 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05663a9_a8b4_4f31_97b0_65bf78322dba.slice/crio-e64ec6f920ae389ffd4761fc6dfc8833d476f15fc5d948b5f2f569032c5f0178 WatchSource:0}: Error finding container e64ec6f920ae389ffd4761fc6dfc8833d476f15fc5d948b5f2f569032c5f0178: Status 404 returned error can't find the container with id e64ec6f920ae389ffd4761fc6dfc8833d476f15fc5d948b5f2f569032c5f0178 Jul 29 22:47:58.860415 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:58.860034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:47:58.862720 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:58.862671 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9da78ca-7140-40c1-8f6e-cf9e8e74ee31-metrics-certs\") pod \"network-metrics-daemon-wrq56\" (UID: \"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31\") " pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:47:58.879872 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:58.879748 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64cd5fb486-xcbcq"] Jul 29 22:47:58.932331 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:58.932294 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4fq52\"" Jul 29 22:47:58.940969 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:58.940886 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrq56" Jul 29 22:47:59.097727 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.097694 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wrq56"] Jul 29 22:47:59.101145 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:47:59.101097 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9da78ca_7140_40c1_8f6e_cf9e8e74ee31.slice/crio-2ca0f28c93dd140ac4c98c5fd7c50dd819e0b7c18710839d6680866798c77272 WatchSource:0}: Error finding container 2ca0f28c93dd140ac4c98c5fd7c50dd819e0b7c18710839d6680866798c77272: Status 404 returned error can't find the container with id 2ca0f28c93dd140ac4c98c5fd7c50dd819e0b7c18710839d6680866798c77272 Jul 29 22:47:59.621521 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.621465 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"e64ec6f920ae389ffd4761fc6dfc8833d476f15fc5d948b5f2f569032c5f0178"} Jul 29 22:47:59.625599 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.625564 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" event={"ID":"66854a91-0aeb-4742-8d6b-03acb4b90420","Type":"ContainerStarted","Data":"6c63d9888e0733e7e8b7bd7810fe5649966ec3bdc741fc6d52e8962641ed9c38"} Jul 29 22:47:59.625722 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.625630 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" event={"ID":"66854a91-0aeb-4742-8d6b-03acb4b90420","Type":"ContainerStarted","Data":"c3ff47afc1429a2d5c1c225a67d6632429f0154b50cdd3209919cdcbcda35f5c"} Jul 29 22:47:59.625722 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.625659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" event={"ID":"66854a91-0aeb-4742-8d6b-03acb4b90420","Type":"ContainerStarted","Data":"1fe8dd1f7e25762acada0ac22c7b2afd1a3a73be720be3a6932db5c629963ea1"} Jul 29 22:47:59.629267 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.629240 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxzb4" event={"ID":"6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac","Type":"ContainerStarted","Data":"8760647e5f2203e52eeed909cfa298f91e054f6d862ec09b95c41b8ac3697994"} Jul 29 22:47:59.632939 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.632914 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" event={"ID":"9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d","Type":"ContainerStarted","Data":"521c0b9b65f01bd17cb606959790cc158fcff8557fa0c37ff87aeeb554e6d1c9"} Jul 29 22:47:59.634975 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.634891 2569 generic.go:356] "Generic (PLEG): container finished" podID="c1f9ff41-6d04-43d8-a6fd-c14b664a0290" containerID="7384c46f0e739ed5ae38fec6964563d1b0524ce00e95cebd8b023b093cf637c8" exitCode=0 Jul 29 22:47:59.635067 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.634971 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdgsf" event={"ID":"c1f9ff41-6d04-43d8-a6fd-c14b664a0290","Type":"ContainerDied","Data":"7384c46f0e739ed5ae38fec6964563d1b0524ce00e95cebd8b023b093cf637c8"} Jul 29 22:47:59.636700 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.636659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrq56" event={"ID":"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31","Type":"ContainerStarted","Data":"2ca0f28c93dd140ac4c98c5fd7c50dd819e0b7c18710839d6680866798c77272"} Jul 29 22:47:59.651682 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.651255 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b4d5v" podStartSLOduration=2.569798314 podStartE2EDuration="6.651237725s" totalImagesPullingTime="4.081439411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:59.649122643 +0000 UTC m=+130.139889120" watchObservedRunningTime="2026-07-29 22:47:59.651237725 +0000 UTC m=+130.142004191" Jul 29 22:47:59.672802 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.671913 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vxzb4" podStartSLOduration=33.653328389 podStartE2EDuration="46.671892331s" totalImagesPullingTime="13.018563942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:47:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:59.67106882 +0000 UTC m=+130.161835306" watchObservedRunningTime="2026-07-29 22:47:59.671892331 +0000 UTC m=+130.162658816" Jul 29 22:47:59.690198 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:47:59.690090 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ctzxz" podStartSLOduration=2.718205403 podStartE2EDuration="6.690062566s" totalImagesPullingTime="3.971857163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:59.689983366 +0000 UTC m=+130.180749852" watchObservedRunningTime="2026-07-29 22:47:59.690062566 +0000 UTC m=+130.180829054" Jul 29 22:48:00.372658 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.372546 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:48:00.378202 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.378174 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.380863 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.380812 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 22:48:00.381011 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.380956 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 22:48:00.381478 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.381458 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 22:48:00.381660 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.381644 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 22:48:00.381854 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.381820 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 22:48:00.382018 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.382003 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 22:48:00.382556 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.382534 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 22:48:00.382556 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.382552 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-efbuhlh3e319h\"" Jul 29 22:48:00.382779 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.382765 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 22:48:00.382998 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.382980 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 22:48:00.383408 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.383118 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 22:48:00.383519 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.383463 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 22:48:00.383586 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.383249 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 22:48:00.383668 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.383370 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wmtpw\"" Jul 29 22:48:00.383668 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.383300 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 22:48:00.384145 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.383974 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 22:48:00.385510 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.385481 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 22:48:00.398354 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.398332 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:48:00.473458 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473361 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473458 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473458 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473479 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473554 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473572 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5nz\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-kube-api-access-ps5nz\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473666 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.473766 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473744 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473777 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473877 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473910 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.473996 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.474022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.474150 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.474052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575394 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575354 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575440 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575472 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575491 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575580 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575578 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575604 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575631 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575677 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5nz\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-kube-api-access-ps5nz\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575802 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575834 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.575928 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.575896 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.576495 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.576048 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.576579 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.576552 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.577595 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.577561 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.583888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.579438 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.583888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.580474 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.583888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.582512 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.583888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.583583 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.584502 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.584476 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.585433 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.585249 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.585867 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.585716 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.586810 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.586783 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.587153 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.587129 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.587450 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.587426 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.587629 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.587485 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.587720 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.587694 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.590048 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.589992 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.590169 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.590044 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.591036 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.590974 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.591896 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.591873 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5nz\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-kube-api-access-ps5nz\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.592030 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.592007 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.646098 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.646014 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdgsf" event={"ID":"c1f9ff41-6d04-43d8-a6fd-c14b664a0290","Type":"ContainerStarted","Data":"5bb518c8ddecc334241054da1043897a9b15fea5c470e07658b6e17b5036f2f9"} Jul 29 22:48:00.646260 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.646136 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdgsf" event={"ID":"c1f9ff41-6d04-43d8-a6fd-c14b664a0290","Type":"ContainerStarted","Data":"f14b7ac05992d539bb1f11d5241fc890f7db2acf274f1c2721a09aaa822b9aee"} Jul 29 22:48:00.673659 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.673605 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tdgsf" podStartSLOduration=3.881957081 podStartE2EDuration="7.67358362s" totalImagesPullingTime="3.70408396s" totalInitContainerRuntime="87.542579ms" isStatefulPod=true podCreationTimestamp="2026-07-29 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:00.672248715 +0000 UTC m=+131.163015201" watchObservedRunningTime="2026-07-29 22:48:00.67358362 +0000 UTC m=+131.164350108" Jul 29 22:48:00.692087 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.691839 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:00.917220 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:00.917168 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:48:00.923794 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:48:00.923762 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ed7412_a833_43ee_8d2c_21dee3fa86a0.slice/crio-86cd129b8462061985b6d999daf962ea5d404ac6299b909f27f361665b3da864 WatchSource:0}: Error finding container 86cd129b8462061985b6d999daf962ea5d404ac6299b909f27f361665b3da864: Status 404 returned error can't find the container with id 86cd129b8462061985b6d999daf962ea5d404ac6299b909f27f361665b3da864 Jul 29 22:48:01.653377 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.653333 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrq56" event={"ID":"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31","Type":"ContainerStarted","Data":"d4358770119d7328993af01b4615c84701e0951ba54c007234c0d47b5053d86f"} Jul 29 22:48:01.653820 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.653404 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrq56" event={"ID":"b9da78ca-7140-40c1-8f6e-cf9e8e74ee31","Type":"ContainerStarted","Data":"5f56b19acca00c98ee8b0102609bbc815df16492093dae6094bc333ffae91286"} Jul 29 22:48:01.656239 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.656151 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"c4c1ceb87ecafdf5b121873e1ebfb0f99af345400cf9b1d5b3eaef08802a6b7d"} Jul 29 22:48:01.656239 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.656234 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"c66844fdc03b314b051c7ff8e52babdc656b0e7e548550e61d6188457b30afa8"} Jul 29 22:48:01.656441 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.656278 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"8c9712ecc759e5e9d4f5ef0d51cde83685866eaac56ebf5557c512e60b79cd9c"} Jul 29 22:48:01.657525 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.657496 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"86cd129b8462061985b6d999daf962ea5d404ac6299b909f27f361665b3da864"} Jul 29 22:48:01.672744 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:01.672678 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wrq56" podStartSLOduration=130.682753635 podStartE2EDuration="2m11.67266169s" totalImagesPullingTime="989.908055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:01.671469886 +0000 UTC m=+132.162236372" watchObservedRunningTime="2026-07-29 22:48:01.67266169 +0000 UTC m=+132.163428174" Jul 29 22:48:02.669335 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.669296 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"24ddbf1959c64289604e3da2313ed557cf9da0c61d60224b356248467551533e"} Jul 29 22:48:02.669810 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.669420 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"4477e46007fe118369c81ee6f35b3bfaf9e396c7dfc16adc883623eb2af7d925"} Jul 29 22:48:02.669810 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.669462 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" event={"ID":"b05663a9-a8b4-4f31-97b0-65bf78322dba","Type":"ContainerStarted","Data":"5de24bc71160ba7d0c44cc0e546232048f0629f16c9f7628f233b3105f31d745"} Jul 29 22:48:02.669810 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.669507 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:48:02.671188 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.671163 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="d2fcaa5cfaa44debf57a658fe5ac4d506a3c104f59771bdddaec5b95dc98ea85" exitCode=0 Jul 29 22:48:02.671319 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.671224 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"d2fcaa5cfaa44debf57a658fe5ac4d506a3c104f59771bdddaec5b95dc98ea85"} Jul 29 22:48:02.731478 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:02.731417 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" podStartSLOduration=3.629766512 podStartE2EDuration="6.73139601s" totalImagesPullingTime="3.101629498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:02.697971188 +0000 UTC m=+133.188737676" watchObservedRunningTime="2026-07-29 22:48:02.73139601 +0000 UTC m=+133.222162495" Jul 29 22:48:08.683621 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:08.683590 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78c4bfcddd-8578k" Jul 29 22:48:13.729597 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.729558 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"bb878326979f3586a742a68d9b6494435e331effda0cafab2c36d4952fd8ceb4"} Jul 29 22:48:13.729966 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.729648 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"2e880b443c2f5773c355d461dd04c1f685b08a30c382ff1cb8732c2542caa4a4"} Jul 29 22:48:13.729966 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.729686 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"5f5d5995965d79d551b7b1ea0df284140e48697a74520f527628c0a2ce2b9b91"} Jul 29 22:48:13.729966 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.729723 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"ea5cb698a1a5995c0af18403afe223539d6ea5c33b8b95d596b7f662f31db1dc"} Jul 29 22:48:13.729966 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.729761 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"61d8d2c7949f88820d12c7d94f44ea8f27bde951cc443ba24d792f1aa8817ecf"} Jul 29 22:48:13.732067 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.732017 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-hd8d8" event={"ID":"a70466f3-9119-4c9d-b45f-f30e0d41a820","Type":"ContainerStarted","Data":"44be5e47860f4240ff6fb3fcd7d51eda5e4a89a0cf0a13948bf5e5bf34b6a8e2"} Jul 29 22:48:13.732808 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.732741 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:48:13.739617 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.739596 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-hd8d8" Jul 29 22:48:13.757607 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:13.757494 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-hd8d8" podStartSLOduration=1.233236212 podStartE2EDuration="19.757473411s" totalImagesPullingTime="18.524237199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:13.757215831 +0000 UTC m=+144.247982318" watchObservedRunningTime="2026-07-29 22:48:13.757473411 +0000 UTC m=+144.248239898" Jul 29 22:48:14.741228 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:14.741183 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerStarted","Data":"9f30fd563e1390c9dbc09cc1c2b7d51c9af0ca53ea51ba8d9a45a9238102d139"} Jul 29 22:48:14.774383 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:14.774317 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.969245357 podStartE2EDuration="14.774294632s" totalImagesPullingTime="11.779392985s" totalInitContainerRuntime="25.65629ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:48:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:14.771723599 +0000 UTC m=+145.262490125" watchObservedRunningTime="2026-07-29 22:48:14.774294632 +0000 UTC m=+145.265061118" Jul 29 22:48:15.692841 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:15.692809 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:48:23.903783 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:23.903712 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" podUID="8a99368f-26f7-4928-a704-176d5208dad2" containerName="registry" containerID="cri-o://5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429" gracePeriod=30 Jul 29 22:48:24.205888 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.205857 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:48:24.292042 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292011 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292232 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292056 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-trusted-ca\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292232 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292081 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-installation-pull-secrets\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292232 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292165 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-bound-sa-token\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292232 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292205 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-image-registry-private-configuration\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292232 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292229 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-registry-certificates\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292492 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292262 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a99368f-26f7-4928-a704-176d5208dad2-ca-trust-extracted\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292492 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292293 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5tfw\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-kube-api-access-x5tfw\") pod \"8a99368f-26f7-4928-a704-176d5208dad2\" (UID: \"8a99368f-26f7-4928-a704-176d5208dad2\") " Jul 29 22:48:24.292592 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292570 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:24.292760 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.292695 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:24.294608 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.294573 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:24.294714 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.294692 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:24.294855 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.294831 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:24.294937 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.294921 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-kube-api-access-x5tfw" (OuterVolumeSpecName: "kube-api-access-x5tfw") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "kube-api-access-x5tfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:24.295227 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.295197 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:24.301438 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.301411 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a99368f-26f7-4928-a704-176d5208dad2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8a99368f-26f7-4928-a704-176d5208dad2" (UID: "8a99368f-26f7-4928-a704-176d5208dad2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:48:24.315781 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.315758 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqmnm_3d476d7f-1f21-4302-990e-42abb089d203/serve-healthcheck-canary/0.log" Jul 29 22:48:24.393121 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393081 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-bound-sa-token\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393135 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-image-registry-private-configuration\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393150 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-registry-certificates\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393164 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a99368f-26f7-4928-a704-176d5208dad2-ca-trust-extracted\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393175 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5tfw\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-kube-api-access-x5tfw\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393185 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a99368f-26f7-4928-a704-176d5208dad2-registry-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393196 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a99368f-26f7-4928-a704-176d5208dad2-trusted-ca\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.393297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.393207 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a99368f-26f7-4928-a704-176d5208dad2-installation-pull-secrets\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:48:24.785234 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.785202 2569 generic.go:356] "Generic (PLEG): container finished" podID="8a99368f-26f7-4928-a704-176d5208dad2" containerID="5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429" exitCode=0 Jul 29 22:48:24.785397 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.785247 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" event={"ID":"8a99368f-26f7-4928-a704-176d5208dad2","Type":"ContainerDied","Data":"5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429"} Jul 29 22:48:24.785397 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.785290 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" event={"ID":"8a99368f-26f7-4928-a704-176d5208dad2","Type":"ContainerDied","Data":"972a584f152448e82656ccc5c7e792e5c5c5edc19b66215d3340e316eb3908c4"} Jul 29 22:48:24.785397 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.785310 2569 scope.go:117] "RemoveContainer" containerID="5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429" Jul 29 22:48:24.785397 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.785252 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fb486-xcbcq" Jul 29 22:48:24.796860 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.796832 2569 scope.go:117] "RemoveContainer" containerID="5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429" Jul 29 22:48:24.797153 ip-10-0-139-98 kubenswrapper[2569]: E0729 22:48:24.797129 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429\": container with ID starting with 5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429 not found: ID does not exist" containerID="5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429" Jul 29 22:48:24.797237 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.797160 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429"} err="failed to get container status \"5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429\": rpc error: code = NotFound desc = could not find container \"5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429\": container with ID starting with 5b84d07b7a422f9cecb9d27cf2edd6ea506a0dbaeb1264910dc650fa94f99429 not found: ID does not exist" Jul 29 22:48:24.812139 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.812100 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64cd5fb486-xcbcq"] Jul 29 22:48:24.821535 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:24.821509 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64cd5fb486-xcbcq"] Jul 29 22:48:25.925041 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:48:25.925003 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a99368f-26f7-4928-a704-176d5208dad2" path="/var/lib/kubelet/pods/8a99368f-26f7-4928-a704-176d5208dad2/volumes" Jul 29 22:49:00.692673 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:00.692633 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:00.759041 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:00.759014 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:00.945630 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:00.945552 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:18.821055 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821020 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:18.821475 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821333 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="prometheus" containerID="cri-o://61d8d2c7949f88820d12c7d94f44ea8f27bde951cc443ba24d792f1aa8817ecf" gracePeriod=600 Jul 29 22:49:18.821475 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821378 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9f30fd563e1390c9dbc09cc1c2b7d51c9af0ca53ea51ba8d9a45a9238102d139" gracePeriod=600 Jul 29 22:49:18.821475 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821397 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="thanos-sidecar" containerID="cri-o://5f5d5995965d79d551b7b1ea0df284140e48697a74520f527628c0a2ce2b9b91" gracePeriod=600 Jul 29 22:49:18.821475 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821422 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-web" containerID="cri-o://2e880b443c2f5773c355d461dd04c1f685b08a30c382ff1cb8732c2542caa4a4" gracePeriod=600 Jul 29 22:49:18.821475 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821433 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="config-reloader" containerID="cri-o://ea5cb698a1a5995c0af18403afe223539d6ea5c33b8b95d596b7f662f31db1dc" gracePeriod=600 Jul 29 22:49:18.821740 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:18.821366 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy" containerID="cri-o://bb878326979f3586a742a68d9b6494435e331effda0cafab2c36d4952fd8ceb4" gracePeriod=600 Jul 29 22:49:19.006459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006424 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="9f30fd563e1390c9dbc09cc1c2b7d51c9af0ca53ea51ba8d9a45a9238102d139" exitCode=0 Jul 29 22:49:19.006459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006454 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="bb878326979f3586a742a68d9b6494435e331effda0cafab2c36d4952fd8ceb4" exitCode=0 Jul 29 22:49:19.006459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006464 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="2e880b443c2f5773c355d461dd04c1f685b08a30c382ff1cb8732c2542caa4a4" exitCode=0 Jul 29 22:49:19.006459 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006472 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="5f5d5995965d79d551b7b1ea0df284140e48697a74520f527628c0a2ce2b9b91" exitCode=0 Jul 29 22:49:19.006761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006480 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="ea5cb698a1a5995c0af18403afe223539d6ea5c33b8b95d596b7f662f31db1dc" exitCode=0 Jul 29 22:49:19.006761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006492 2569 generic.go:356] "Generic (PLEG): container finished" podID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerID="61d8d2c7949f88820d12c7d94f44ea8f27bde951cc443ba24d792f1aa8817ecf" exitCode=0 Jul 29 22:49:19.006761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006580 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"9f30fd563e1390c9dbc09cc1c2b7d51c9af0ca53ea51ba8d9a45a9238102d139"} Jul 29 22:49:19.006761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006655 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"bb878326979f3586a742a68d9b6494435e331effda0cafab2c36d4952fd8ceb4"} Jul 29 22:49:19.006761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006704 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"2e880b443c2f5773c355d461dd04c1f685b08a30c382ff1cb8732c2542caa4a4"} Jul 29 22:49:19.006761 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006749 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"5f5d5995965d79d551b7b1ea0df284140e48697a74520f527628c0a2ce2b9b91"} Jul 29 22:49:19.007079 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006791 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"ea5cb698a1a5995c0af18403afe223539d6ea5c33b8b95d596b7f662f31db1dc"} Jul 29 22:49:19.007079 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.006829 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"61d8d2c7949f88820d12c7d94f44ea8f27bde951cc443ba24d792f1aa8817ecf"} Jul 29 22:49:19.064805 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.064782 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:19.134560 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134529 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134734 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134574 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-kube-rbac-proxy\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134734 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134604 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-grpc-tls\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134863 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134782 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps5nz\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-kube-api-access-ps5nz\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134863 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134829 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-kubelet-serving-ca-bundle\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134967 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134866 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-2\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134967 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134893 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-metrics-client-certs\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134967 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134925 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-1\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.134967 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.134967 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-tls-assets\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135210 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135002 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-tls\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135210 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135028 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-0\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135210 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135051 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config-out\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135210 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135090 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135210 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135155 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-thanos-prometheus-http-client-file\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135210 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135193 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-trusted-ca-bundle\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135217 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-metrics-client-ca\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135251 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-db\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135278 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135304 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-serving-certs-ca-bundle\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135344 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-web-config\") pod \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\" (UID: \"57ed7412-a833-43ee-8d2c-21dee3fa86a0\") " Jul 29 22:49:19.135514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135461 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.135808 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135711 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.135869 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.135841 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.136029 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.136005 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.136363 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.136334 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.137004 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.136978 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.137648 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.137449 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.138301 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.138244 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:19.138391 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.138363 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config" (OuterVolumeSpecName: "config") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.138454 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.138410 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.138507 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.138462 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:19.138569 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.138500 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.139511 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.139441 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.139511 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.139477 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.140086 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.140053 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config-out" (OuterVolumeSpecName: "config-out") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:19.140198 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.140072 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.140321 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.140298 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-kube-api-access-ps5nz" (OuterVolumeSpecName: "kube-api-access-ps5nz") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "kube-api-access-ps5nz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:19.140550 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.140502 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:19.140788 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.140765 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.141319 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.141295 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.149858 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.149836 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-web-config" (OuterVolumeSpecName: "web-config") pod "57ed7412-a833-43ee-8d2c-21dee3fa86a0" (UID: "57ed7412-a833-43ee-8d2c-21dee3fa86a0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:19.236421 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236387 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236421 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236415 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236421 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236426 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-web-config\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236436 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236445 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-kube-rbac-proxy\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236465 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-grpc-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236475 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps5nz\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-kube-api-access-ps5nz\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236489 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236498 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-metrics-client-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236507 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236515 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57ed7412-a833-43ee-8d2c-21dee3fa86a0-tls-assets\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236523 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236531 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236539 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-config-out\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236547 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236556 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57ed7412-a833-43ee-8d2c-21dee3fa86a0-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236564 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236573 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ed7412-a833-43ee-8d2c-21dee3fa86a0-configmap-metrics-client-ca\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:19.236646 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:19.236582 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57ed7412-a833-43ee-8d2c-21dee3fa86a0-prometheus-k8s-db\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 22:49:20.013482 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.013447 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57ed7412-a833-43ee-8d2c-21dee3fa86a0","Type":"ContainerDied","Data":"86cd129b8462061985b6d999daf962ea5d404ac6299b909f27f361665b3da864"} Jul 29 22:49:20.013482 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.013467 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.013977 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.013537 2569 scope.go:117] "RemoveContainer" containerID="9f30fd563e1390c9dbc09cc1c2b7d51c9af0ca53ea51ba8d9a45a9238102d139" Jul 29 22:49:20.021272 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.021254 2569 scope.go:117] "RemoveContainer" containerID="bb878326979f3586a742a68d9b6494435e331effda0cafab2c36d4952fd8ceb4" Jul 29 22:49:20.027832 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.027816 2569 scope.go:117] "RemoveContainer" containerID="2e880b443c2f5773c355d461dd04c1f685b08a30c382ff1cb8732c2542caa4a4" Jul 29 22:49:20.034330 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.034313 2569 scope.go:117] "RemoveContainer" containerID="5f5d5995965d79d551b7b1ea0df284140e48697a74520f527628c0a2ce2b9b91" Jul 29 22:49:20.040504 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.040482 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:20.041412 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.041392 2569 scope.go:117] "RemoveContainer" containerID="ea5cb698a1a5995c0af18403afe223539d6ea5c33b8b95d596b7f662f31db1dc" Jul 29 22:49:20.046733 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.046711 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:20.048442 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.048417 2569 scope.go:117] "RemoveContainer" containerID="61d8d2c7949f88820d12c7d94f44ea8f27bde951cc443ba24d792f1aa8817ecf" Jul 29 22:49:20.055231 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.055211 2569 scope.go:117] "RemoveContainer" containerID="d2fcaa5cfaa44debf57a658fe5ac4d506a3c104f59771bdddaec5b95dc98ea85" Jul 29 22:49:20.103811 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.103740 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:20.104090 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104074 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-web" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104093 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-web" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104118 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104128 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104140 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="prometheus" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104149 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="prometheus" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104172 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="thanos-sidecar" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104180 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="thanos-sidecar" Jul 29 22:49:20.104206 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104202 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="init-config-reloader" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104210 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="init-config-reloader" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104220 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="config-reloader" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104227 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="config-reloader" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104240 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a99368f-26f7-4928-a704-176d5208dad2" containerName="registry" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104249 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a99368f-26f7-4928-a704-176d5208dad2" containerName="registry" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104263 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-thanos" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104270 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-thanos" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104351 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="config-reloader" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104364 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="prometheus" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104372 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a99368f-26f7-4928-a704-176d5208dad2" containerName="registry" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104382 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="thanos-sidecar" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104391 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-web" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104400 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy" Jul 29 22:49:20.104578 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.104408 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" containerName="kube-rbac-proxy-thanos" Jul 29 22:49:20.110176 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.109286 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.112409 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.112390 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 22:49:20.112514 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.112488 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 22:49:20.113564 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.113541 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 22:49:20.114178 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114129 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 22:49:20.114262 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114169 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 22:49:20.114262 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114189 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wmtpw\"" Jul 29 22:49:20.114262 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114217 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 22:49:20.114815 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114797 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 22:49:20.114895 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114851 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 22:49:20.114895 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114858 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 22:49:20.114895 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114863 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 22:49:20.115051 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114932 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 22:49:20.115051 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.114970 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 22:49:20.115396 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.115379 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 22:49:20.115460 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.115446 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-efbuhlh3e319h\"" Jul 29 22:49:20.117297 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.117277 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 22:49:20.120533 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.120516 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 22:49:20.126836 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.126816 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:20.243686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243744 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243773 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243837 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-config\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.243876 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243858 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243907 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.243989 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bln\" (UniqueName: \"kubernetes.io/projected/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-kube-api-access-j4bln\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244032 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244051 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244132 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244207 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244507 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244220 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.244507 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.244250 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345455 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345455 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345458 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-config\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345475 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345493 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345533 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345547 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bln\" (UniqueName: \"kubernetes.io/projected/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-kube-api-access-j4bln\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345574 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345617 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.345686 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345799 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345822 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345894 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345928 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.345977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.346008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346040 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.346016 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346605 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.346339 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.346605 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.346362 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.348419 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.347330 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.349383 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.349359 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.349576 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.349553 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.349658 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.349613 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.349808 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.349789 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.350426 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.349988 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.350426 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.349988 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.350426 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.350197 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-config\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.351256 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.350568 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.351256 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.350716 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.351256 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.351018 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.351256 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.351081 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.351457 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.351395 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.351837 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.351810 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.352143 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.352097 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.352280 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.352265 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.356217 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.356160 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bln\" (UniqueName: \"kubernetes.io/projected/e685ae64-5c53-4f44-bfe7-cb9e4686a27a-kube-api-access-j4bln\") pod \"prometheus-k8s-0\" (UID: \"e685ae64-5c53-4f44-bfe7-cb9e4686a27a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.420620 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.420587 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:49:20.559276 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:20.559242 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 22:49:20.562188 ip-10-0-139-98 kubenswrapper[2569]: W0729 22:49:20.562159 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode685ae64_5c53_4f44_bfe7_cb9e4686a27a.slice/crio-307a9b34b2beab70d7f6bc91b7be496a1b9a37b031d1b818aa06497b5d424bac WatchSource:0}: Error finding container 307a9b34b2beab70d7f6bc91b7be496a1b9a37b031d1b818aa06497b5d424bac: Status 404 returned error can't find the container with id 307a9b34b2beab70d7f6bc91b7be496a1b9a37b031d1b818aa06497b5d424bac Jul 29 22:49:21.018663 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:21.018581 2569 generic.go:356] "Generic (PLEG): container finished" podID="e685ae64-5c53-4f44-bfe7-cb9e4686a27a" containerID="824fa8f2eb2f825e4015c0a3bdda281f54e5fc0fed85eaf9d9649e89ac6ece44" exitCode=0 Jul 29 22:49:21.019129 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:21.018670 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerDied","Data":"824fa8f2eb2f825e4015c0a3bdda281f54e5fc0fed85eaf9d9649e89ac6ece44"} Jul 29 22:49:21.019129 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:21.018738 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"307a9b34b2beab70d7f6bc91b7be496a1b9a37b031d1b818aa06497b5d424bac"} Jul 29 22:49:21.929476 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:21.929441 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ed7412-a833-43ee-8d2c-21dee3fa86a0" path="/var/lib/kubelet/pods/57ed7412-a833-43ee-8d2c-21dee3fa86a0/volumes" Jul 29 22:49:22.027333 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.027297 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"0d2724e47b4a62e1dfe0bbfdd519767d6d7794574fa2085090dc7797b66192e3"} Jul 29 22:49:22.027716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.027360 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"738cdf4f1b4b439444af70975c836bf47aac3b11b5b893a94232487276dfd732"} Jul 29 22:49:22.027716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.027387 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"66c9f6107cf37b538ec938ccb766aba3671dd8643e7d6dd0f3f66f61eb0b5833"} Jul 29 22:49:22.027716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.027415 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"7b4180d3baa218563a5e62910a37a1cd6293a222dbd445f95d28b08307f38311"} Jul 29 22:49:22.027716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.027439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"3bbb3feae9e7f54f2ce79b2969bdfeaba1bc672d21269fdb03f76d0e2f728adf"} Jul 29 22:49:22.027716 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.027461 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e685ae64-5c53-4f44-bfe7-cb9e4686a27a","Type":"ContainerStarted","Data":"b71d0187a3f3aacbbdddc164f4cfaa4af328961798b5b76f59bc4d2cbac9220f"} Jul 29 22:49:22.060803 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:22.060753 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.039711461 podStartE2EDuration="2.060737554s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.026093ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:49:22.058085069 +0000 UTC m=+212.548851594" watchObservedRunningTime="2026-07-29 22:49:22.060737554 +0000 UTC m=+212.551504040" Jul 29 22:49:25.421267 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:49:25.421224 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:20.421707 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:50:20.421624 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:20.437049 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:50:20.437022 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:21.265531 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:50:21.265503 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 22:50:49.871674 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:50:49.871642 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 22:50:49.878238 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:50:49.878212 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 22:50:49.882324 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:50:49.882301 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 22:55:49.903894 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:55:49.903861 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 22:55:49.908992 ip-10-0-139-98 kubenswrapper[2569]: I0729 22:55:49.908967 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 23:00:49.932815 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:00:49.932743 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 23:00:49.935173 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:00:49.934857 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 23:04:18.746081 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.746000 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kw2qf/must-gather-f9nnx"] Jul 29 23:04:18.749283 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.749267 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:18.751806 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.751784 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kw2qf\"/\"kube-root-ca.crt\"" Jul 29 23:04:18.751939 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.751879 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kw2qf\"/\"openshift-service-ca.crt\"" Jul 29 23:04:18.751939 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.751903 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kw2qf\"/\"default-dockercfg-km8j6\"" Jul 29 23:04:18.766866 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.766841 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kw2qf/must-gather-f9nnx"] Jul 29 23:04:18.799971 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.799937 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a5ad525-8539-44e4-a737-e081a4b00282-must-gather-output\") pod \"must-gather-f9nnx\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:18.800152 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.799980 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjddw\" (UniqueName: \"kubernetes.io/projected/2a5ad525-8539-44e4-a737-e081a4b00282-kube-api-access-cjddw\") pod \"must-gather-f9nnx\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:18.900976 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.900944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a5ad525-8539-44e4-a737-e081a4b00282-must-gather-output\") pod \"must-gather-f9nnx\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:18.900976 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.900980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjddw\" (UniqueName: \"kubernetes.io/projected/2a5ad525-8539-44e4-a737-e081a4b00282-kube-api-access-cjddw\") pod \"must-gather-f9nnx\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:18.901320 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.901300 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a5ad525-8539-44e4-a737-e081a4b00282-must-gather-output\") pod \"must-gather-f9nnx\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:18.909748 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:18.909722 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjddw\" (UniqueName: \"kubernetes.io/projected/2a5ad525-8539-44e4-a737-e081a4b00282-kube-api-access-cjddw\") pod \"must-gather-f9nnx\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:19.067279 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:19.067193 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:19.191236 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:19.191214 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kw2qf/must-gather-f9nnx"] Jul 29 23:04:19.193859 ip-10-0-139-98 kubenswrapper[2569]: W0729 23:04:19.193833 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a5ad525_8539_44e4_a737_e081a4b00282.slice/crio-a28832661825e46f051550662d6479eb4a1d906e57d8e9275b5720123ad6c6e1 WatchSource:0}: Error finding container a28832661825e46f051550662d6479eb4a1d906e57d8e9275b5720123ad6c6e1: Status 404 returned error can't find the container with id a28832661825e46f051550662d6479eb4a1d906e57d8e9275b5720123ad6c6e1 Jul 29 23:04:19.195752 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:19.195733 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 23:04:19.380056 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:19.380017 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" event={"ID":"2a5ad525-8539-44e4-a737-e081a4b00282","Type":"ContainerStarted","Data":"a28832661825e46f051550662d6479eb4a1d906e57d8e9275b5720123ad6c6e1"} Jul 29 23:04:26.417995 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:26.417952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" event={"ID":"2a5ad525-8539-44e4-a737-e081a4b00282","Type":"ContainerStarted","Data":"c35db03e04d55698dc042ddfe9436d84b243e1c9613aef3c678e499721823c6c"} Jul 29 23:04:26.418460 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:26.418013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" event={"ID":"2a5ad525-8539-44e4-a737-e081a4b00282","Type":"ContainerStarted","Data":"4b52cef3d57f0ccc10cd03b579d0ec62382ddd158a0210fa1d0fdf6fd5ed34dc"} Jul 29 23:04:26.435221 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:26.435170 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" podStartSLOduration=2.226968082 podStartE2EDuration="8.435150928s" totalImagesPullingTime="6.208182846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 23:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 23:04:26.434802902 +0000 UTC m=+1116.925569424" watchObservedRunningTime="2026-07-29 23:04:26.435150928 +0000 UTC m=+1116.925917414" Jul 29 23:04:38.469274 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:38.469235 2569 generic.go:356] "Generic (PLEG): container finished" podID="2a5ad525-8539-44e4-a737-e081a4b00282" containerID="4b52cef3d57f0ccc10cd03b579d0ec62382ddd158a0210fa1d0fdf6fd5ed34dc" exitCode=0 Jul 29 23:04:38.469274 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:38.469268 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" event={"ID":"2a5ad525-8539-44e4-a737-e081a4b00282","Type":"ContainerDied","Data":"4b52cef3d57f0ccc10cd03b579d0ec62382ddd158a0210fa1d0fdf6fd5ed34dc"} Jul 29 23:04:38.469711 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:38.469588 2569 scope.go:117] "RemoveContainer" containerID="4b52cef3d57f0ccc10cd03b579d0ec62382ddd158a0210fa1d0fdf6fd5ed34dc" Jul 29 23:04:38.994012 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:38.993986 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kw2qf_must-gather-f9nnx_2a5ad525-8539-44e4-a737-e081a4b00282/gather/0.log" Jul 29 23:04:42.203126 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:42.203074 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t2fvl_565ea92c-5654-4024-b67d-9e40473eb5d3/global-pull-secret-syncer/0.log" Jul 29 23:04:42.326090 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:42.326045 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t9pnv_8dff548c-59fa-4284-a249-af3cbc6608cf/konnectivity-agent/0.log" Jul 29 23:04:42.377914 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:42.377883 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-98.ec2.internal_89d65a12d350978c7bc79752021005ef/haproxy/0.log" Jul 29 23:04:44.280218 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.280184 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-kw2qf/must-gather-f9nnx"] Jul 29 23:04:44.280740 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.280352 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="copy" containerID="cri-o://c35db03e04d55698dc042ddfe9436d84b243e1c9613aef3c678e499721823c6c" gracePeriod=2 Jul 29 23:04:44.288188 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.288161 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-kw2qf/must-gather-f9nnx"] Jul 29 23:04:44.288634 ip-10-0-139-98 kubenswrapper[2569]: E0729 23:04:44.288601 2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2a5ad525-8539-44e4-a737-e081a4b00282\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-kw2qf\"/\"must-gather-f9nnx\": pods \"must-gather-f9nnx\" not found" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:44.491687 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.491661 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kw2qf_must-gather-f9nnx_2a5ad525-8539-44e4-a737-e081a4b00282/copy/0.log" Jul 29 23:04:44.492030 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.492009 2569 generic.go:356] "Generic (PLEG): container finished" podID="2a5ad525-8539-44e4-a737-e081a4b00282" containerID="c35db03e04d55698dc042ddfe9436d84b243e1c9613aef3c678e499721823c6c" exitCode=143 Jul 29 23:04:44.515494 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.515475 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kw2qf_must-gather-f9nnx_2a5ad525-8539-44e4-a737-e081a4b00282/copy/0.log" Jul 29 23:04:44.516937 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.516921 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:44.519020 ip-10-0-139-98 kubenswrapper[2569]: E0729 23:04:44.518997 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f9nnx\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kw2qf\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:44.620815 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.620782 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a5ad525-8539-44e4-a737-e081a4b00282-must-gather-output\") pod \"2a5ad525-8539-44e4-a737-e081a4b00282\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " Jul 29 23:04:44.620815 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.620824 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjddw\" (UniqueName: \"kubernetes.io/projected/2a5ad525-8539-44e4-a737-e081a4b00282-kube-api-access-cjddw\") pod \"2a5ad525-8539-44e4-a737-e081a4b00282\" (UID: \"2a5ad525-8539-44e4-a737-e081a4b00282\") " Jul 29 23:04:44.621269 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.621240 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a5ad525-8539-44e4-a737-e081a4b00282-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2a5ad525-8539-44e4-a737-e081a4b00282" (UID: "2a5ad525-8539-44e4-a737-e081a4b00282"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 23:04:44.623038 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.623011 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a5ad525-8539-44e4-a737-e081a4b00282-kube-api-access-cjddw" (OuterVolumeSpecName: "kube-api-access-cjddw") pod "2a5ad525-8539-44e4-a737-e081a4b00282" (UID: "2a5ad525-8539-44e4-a737-e081a4b00282"). InnerVolumeSpecName "kube-api-access-cjddw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 23:04:44.722163 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.722087 2569 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a5ad525-8539-44e4-a737-e081a4b00282-must-gather-output\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 23:04:44.722163 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:44.722159 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjddw\" (UniqueName: \"kubernetes.io/projected/2a5ad525-8539-44e4-a737-e081a4b00282-kube-api-access-cjddw\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\"" Jul 29 23:04:45.497156 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:45.497099 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kw2qf_must-gather-f9nnx_2a5ad525-8539-44e4-a737-e081a4b00282/copy/0.log" Jul 29 23:04:45.497529 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:45.497473 2569 scope.go:117] "RemoveContainer" containerID="c35db03e04d55698dc042ddfe9436d84b243e1c9613aef3c678e499721823c6c" Jul 29 23:04:45.497529 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:45.497522 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:45.499874 ip-10-0-139-98 kubenswrapper[2569]: E0729 23:04:45.499843 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f9nnx\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kw2qf\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:45.506847 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:45.506831 2569 scope.go:117] "RemoveContainer" containerID="4b52cef3d57f0ccc10cd03b579d0ec62382ddd158a0210fa1d0fdf6fd5ed34dc" Jul 29 23:04:45.508981 ip-10-0-139-98 kubenswrapper[2569]: E0729 23:04:45.508955 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f9nnx\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kw2qf\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" pod="openshift-must-gather-kw2qf/must-gather-f9nnx" Jul 29 23:04:45.924662 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:45.924628 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" path="/var/lib/kubelet/pods/2a5ad525-8539-44e4-a737-e081a4b00282/volumes" Jul 29 23:04:46.989265 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:46.989235 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b4d5v_66854a91-0aeb-4742-8d6b-03acb4b90420/kube-state-metrics/0.log" Jul 29 23:04:47.014426 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.014405 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b4d5v_66854a91-0aeb-4742-8d6b-03acb4b90420/kube-rbac-proxy-main/0.log" Jul 29 23:04:47.041025 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.040997 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b4d5v_66854a91-0aeb-4742-8d6b-03acb4b90420/kube-rbac-proxy-self/0.log" Jul 29 23:04:47.252791 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.252704 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdgsf_c1f9ff41-6d04-43d8-a6fd-c14b664a0290/node-exporter/0.log" Jul 29 23:04:47.275381 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.275352 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdgsf_c1f9ff41-6d04-43d8-a6fd-c14b664a0290/kube-rbac-proxy/0.log" Jul 29 23:04:47.298232 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.298204 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdgsf_c1f9ff41-6d04-43d8-a6fd-c14b664a0290/init-textfile/0.log" Jul 29 23:04:47.419752 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.419725 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ctzxz_9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d/kube-rbac-proxy-main/0.log" Jul 29 23:04:47.446239 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.446207 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ctzxz_9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d/kube-rbac-proxy-self/0.log" Jul 29 23:04:47.472557 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.472528 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ctzxz_9480c7f2-fd2f-4aa8-9001-0c25f8c59a3d/openshift-state-metrics/0.log" Jul 29 23:04:47.518771 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.518695 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/prometheus/0.log" Jul 29 23:04:47.538705 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.538686 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/config-reloader/0.log" Jul 29 23:04:47.564527 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.564501 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/thanos-sidecar/0.log" Jul 29 23:04:47.590667 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.590645 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/kube-rbac-proxy-web/0.log" Jul 29 23:04:47.616956 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.616931 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/kube-rbac-proxy/0.log" Jul 29 23:04:47.641521 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.641500 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/kube-rbac-proxy-thanos/0.log" Jul 29 23:04:47.666327 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.666306 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e685ae64-5c53-4f44-bfe7-cb9e4686a27a/init-config-reloader/0.log" Jul 29 23:04:47.748607 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.748585 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-22rdk_47ea43b1-10ce-4af7-b3d9-f3b7d2cd9978/prometheus-operator-admission-webhook/0.log" Jul 29 23:04:47.894343 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.894319 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c4bfcddd-8578k_b05663a9-a8b4-4f31-97b0-65bf78322dba/thanos-query/0.log" Jul 29 23:04:47.929789 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.929762 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c4bfcddd-8578k_b05663a9-a8b4-4f31-97b0-65bf78322dba/kube-rbac-proxy-web/0.log" Jul 29 23:04:47.971199 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:47.971170 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c4bfcddd-8578k_b05663a9-a8b4-4f31-97b0-65bf78322dba/kube-rbac-proxy/0.log" Jul 29 23:04:48.004440 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:48.004414 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c4bfcddd-8578k_b05663a9-a8b4-4f31-97b0-65bf78322dba/prom-label-proxy/0.log" Jul 29 23:04:48.029966 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:48.029941 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c4bfcddd-8578k_b05663a9-a8b4-4f31-97b0-65bf78322dba/kube-rbac-proxy-rules/0.log" Jul 29 23:04:48.068420 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:48.068396 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c4bfcddd-8578k_b05663a9-a8b4-4f31-97b0-65bf78322dba/kube-rbac-proxy-metrics/0.log" Jul 29 23:04:49.824979 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:49.824944 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/2.log" Jul 29 23:04:49.831932 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:49.831908 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-krrc9_320be804-f6c4-4683-87f2-2da796ebdebf/console-operator/3.log" Jul 29 23:04:50.274493 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.274466 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-hd8d8_a70466f3-9119-4c9d-b45f-f30e0d41a820/download-server/0.log" Jul 29 23:04:50.550565 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550488 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6"] Jul 29 23:04:50.550793 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550782 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="copy" Jul 29 23:04:50.550834 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550794 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="copy" Jul 29 23:04:50.550834 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550804 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="gather" Jul 29 23:04:50.550834 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550809 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="gather" Jul 29 23:04:50.550930 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550871 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="gather" Jul 29 23:04:50.550930 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.550881 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a5ad525-8539-44e4-a737-e081a4b00282" containerName="copy" Jul 29 23:04:50.553314 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.553295 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.555892 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.555872 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m6zn\"/\"openshift-service-ca.crt\"" Jul 29 23:04:50.555995 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.555874 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m6zn\"/\"default-dockercfg-n77pb\"" Jul 29 23:04:50.556860 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.556846 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m6zn\"/\"kube-root-ca.crt\"" Jul 29 23:04:50.563080 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.563057 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6"] Jul 29 23:04:50.671506 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.671470 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-proc\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.671665 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.671521 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-podres\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.671665 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.671547 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-sys\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.671665 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.671572 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-lib-modules\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.671665 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.671592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtkv\" (UniqueName: \"kubernetes.io/projected/a93a28b6-9e2c-4546-b1ad-e641579f05a2-kube-api-access-2rtkv\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.772808 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtkv\" (UniqueName: \"kubernetes.io/projected/a93a28b6-9e2c-4546-b1ad-e641579f05a2-kube-api-access-2rtkv\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773001 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-proc\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773001 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772869 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-podres\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773001 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772887 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-sys\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773001 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772906 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-lib-modules\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773001 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772989 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-sys\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773221 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.772991 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-proc\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773221 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.773042 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-lib-modules\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.773221 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.773042 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a93a28b6-9e2c-4546-b1ad-e641579f05a2-podres\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.782810 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.782788 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtkv\" (UniqueName: \"kubernetes.io/projected/a93a28b6-9e2c-4546-b1ad-e641579f05a2-kube-api-access-2rtkv\") pod \"perf-node-gather-daemonset-srfq6\" (UID: \"a93a28b6-9e2c-4546-b1ad-e641579f05a2\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.863460 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.863427 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:50.986344 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:50.986310 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6"] Jul 29 23:04:50.989760 ip-10-0-139-98 kubenswrapper[2569]: W0729 23:04:50.989737 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda93a28b6_9e2c_4546_b1ad_e641579f05a2.slice/crio-f716c4f0326e4286b0a3276f6e5b2188828a20ff143d3f043bb2d95bae624316 WatchSource:0}: Error finding container f716c4f0326e4286b0a3276f6e5b2188828a20ff143d3f043bb2d95bae624316: Status 404 returned error can't find the container with id f716c4f0326e4286b0a3276f6e5b2188828a20ff143d3f043bb2d95bae624316 Jul 29 23:04:51.522195 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.522157 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" event={"ID":"a93a28b6-9e2c-4546-b1ad-e641579f05a2","Type":"ContainerStarted","Data":"aa4ab74085649a7702679e3254b39f8592515594630922fab228c6ccb1b20e4f"} Jul 29 23:04:51.522397 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.522208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" event={"ID":"a93a28b6-9e2c-4546-b1ad-e641579f05a2","Type":"ContainerStarted","Data":"f716c4f0326e4286b0a3276f6e5b2188828a20ff143d3f043bb2d95bae624316"} Jul 29 23:04:51.522397 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.522333 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:04:51.539795 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.539747 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" podStartSLOduration=1.539732455 podStartE2EDuration="1.539732455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 23:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 23:04:51.538515157 +0000 UTC m=+1142.029281622" watchObservedRunningTime="2026-07-29 23:04:51.539732455 +0000 UTC m=+1142.030498940" Jul 29 23:04:51.830316 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.830295 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dnwls_54ec08b6-cb98-4382-ab3e-15cabb772d5b/dns/0.log" Jul 29 23:04:51.855020 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.854990 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dnwls_54ec08b6-cb98-4382-ab3e-15cabb772d5b/kube-rbac-proxy/0.log" Jul 29 23:04:51.960907 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:51.960878 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm4l8_bf3ac0df-73b0-4012-8826-271ed3cb70aa/dns-node-resolver/0.log" Jul 29 23:04:52.495921 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:52.495893 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wvgb_eb643171-ab1a-4b6d-89d9-9dac9c5a493b/node-ca/0.log" Jul 29 23:04:53.731098 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:53.731065 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqmnm_3d476d7f-1f21-4302-990e-42abb089d203/serve-healthcheck-canary/0.log" Jul 29 23:04:54.265342 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:54.265314 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxzb4_6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac/kube-rbac-proxy/0.log" Jul 29 23:04:54.287869 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:54.287841 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxzb4_6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac/exporter/0.log" Jul 29 23:04:54.311538 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:54.311511 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxzb4_6a6c1ecc-98f9-4ead-8f23-1bbcab0567ac/extractor/0.log" Jul 29 23:04:57.536506 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:04:57.536476 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-srfq6" Jul 29 23:05:02.387566 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.387535 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/kube-multus-additional-cni-plugins/0.log" Jul 29 23:05:02.413468 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.413437 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/egress-router-binary-copy/0.log" Jul 29 23:05:02.436314 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.436293 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/cni-plugins/0.log" Jul 29 23:05:02.463987 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.463962 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/bond-cni-plugin/0.log" Jul 29 23:05:02.488620 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.488593 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/routeoverride-cni/0.log" Jul 29 23:05:02.511873 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.511845 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/whereabouts-cni-bincopy/0.log" Jul 29 23:05:02.537461 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.537438 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnwtp_2c287841-fa0f-4e19-a626-8045fcb66dad/whereabouts-cni/0.log" Jul 29 23:05:02.959046 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:02.959022 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hm8q4_61e7fdac-01c6-42c3-afc7-9d99e7776404/kube-multus/0.log" Jul 29 23:05:03.030698 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.030671 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wrq56_b9da78ca-7140-40c1-8f6e-cf9e8e74ee31/network-metrics-daemon/0.log" Jul 29 23:05:03.052553 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.052493 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wrq56_b9da78ca-7140-40c1-8f6e-cf9e8e74ee31/kube-rbac-proxy/0.log" Jul 29 23:05:03.878782 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.878757 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/ovn-controller/0.log" Jul 29 23:05:03.902513 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.902490 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/ovn-acl-logging/0.log" Jul 29 23:05:03.937698 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.937671 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/kube-rbac-proxy-node/0.log" Jul 29 23:05:03.964736 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.964704 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 23:05:03.985406 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:03.985385 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/northd/0.log" Jul 29 23:05:04.009303 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:04.009282 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/nbdb/0.log" Jul 29 23:05:04.036301 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:04.036264 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/sbdb/0.log" Jul 29 23:05:04.097022 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:04.096991 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tjnc_191bd427-74bb-4fa7-bffc-5e78e319024f/ovnkube-controller/0.log" Jul 29 23:05:05.601353 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:05.601325 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-7vjfx_f9244074-142c-405c-bd2e-bb37f98936bb/check-endpoints/0.log" Jul 29 23:05:05.656613 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:05.656579 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lxq2f_38125471-addd-487e-bea4-c00f9750ed19/network-check-target-container/0.log" Jul 29 23:05:06.718673 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:06.718638 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-x7zgx_a69b0251-0d36-46cc-995a-898b931b4c7a/iptables-alerter/0.log" Jul 29 23:05:07.415202 ip-10-0-139-98 kubenswrapper[2569]: I0729 23:05:07.415172 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kg86g_04b1c88c-4cc7-4430-96f5-d75ac1234d8b/tuned/0.log"