Jul 29 15:01:44.236912 ip-10-0-130-24 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:01:44.625696 ip-10-0-130-24 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:44.625696 ip-10-0-130-24 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:01:44.625696 ip-10-0-130-24 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:44.625696 ip-10-0-130-24 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:01:44.625696 ip-10-0-130-24 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:44.626737 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.626599 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:01:44.632488 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632466 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.632488 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632487 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.632488 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632491 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632494 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632497 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632500 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632502 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632505 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632508 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632511 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632514 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632516 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632520 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632523 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632525 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632528 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632530 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632538 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632541 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632544 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632546 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632549 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.632584 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632551 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632554 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632556 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632561 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632564 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632566 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632569 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632571 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632574 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632576 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632579 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632581 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632583 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632587 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632589 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632593 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632596 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632599 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.633068 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632602 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632604 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632619 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632622 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632625 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632628 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632630 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632633 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632635 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632639 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632641 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632644 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632647 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632651 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632655 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632658 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632661 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632663 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632667 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.633528 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632672 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632675 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632678 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632681 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632684 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632686 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632689 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632691 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632695 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632698 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632701 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632703 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632706 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632709 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632712 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632715 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632717 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632720 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632725 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632728 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.634139 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632731 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632734 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632738 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632742 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632745 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632748 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632750 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632753 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632756 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632758 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632762 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632764 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632767 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632770 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632772 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632775 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632778 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632780 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.632783 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.634665 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634324 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634332 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634336 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634339 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634342 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634345 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634347 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634350 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634353 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634355 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634358 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634360 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634363 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634366 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634368 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634372 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634375 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634378 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634381 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.635122 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634383 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634386 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634388 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634391 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634394 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634396 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634399 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634401 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634404 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634406 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634408 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634411 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634413 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634416 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634419 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634421 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634425 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634430 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634433 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634436 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.635631 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634438 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634441 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634443 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634446 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634448 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634451 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634453 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634456 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634459 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634462 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634464 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634467 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634471 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634473 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634476 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634478 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634481 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634484 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634487 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634489 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634492 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.636133 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634494 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634497 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634500 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634503 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634505 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634508 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634510 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634513 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634516 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634518 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634521 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634523 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634525 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634528 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634531 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634534 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634536 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634538 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634541 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.636653 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634545 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634549 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634552 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634555 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634558 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634561 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634565 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634569 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634572 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634575 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634578 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634581 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634584 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634587 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634590 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634592 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634595 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634597 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634600 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.637124 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.634602 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635007 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635013 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635016 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635019 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635021 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635024 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635027 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635030 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635032 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635035 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635038 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635041 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635044 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635046 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635049 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635051 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635055 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635058 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635060 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.637589 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635062 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635066 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635068 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635071 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635074 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635076 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635079 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635081 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635084 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635086 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635090 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635094 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635096 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635099 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635102 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635104 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635107 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635109 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635112 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.638091 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635114 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635117 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635119 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635121 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635127 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635129 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635132 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635135 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635137 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635140 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635143 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635146 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635149 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635151 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635154 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635156 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635160 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635164 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635167 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.638553 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635170 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635172 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635175 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635178 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635181 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635183 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635186 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635188 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635191 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635193 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635196 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635198 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635201 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635203 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635206 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635209 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635211 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635214 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635217 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635220 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.639066 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635222 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635225 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635227 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635231 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635233 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635236 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635239 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635241 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635244 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635246 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635249 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635252 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635255 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635259 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635262 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635264 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635267 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635270 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635273 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635276 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.639571 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635279 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.635282 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635362 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635373 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635379 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635384 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635389 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635392 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635396 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635401 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635404 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635407 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635411 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635414 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635417 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635421 2578 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635423 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635427 2578 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635430 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635433 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635438 2578 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635441 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635444 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635447 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:01:44.640081 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635450 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635454 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635457 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635460 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635463 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635466 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635469 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635472 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635475 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635478 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635481 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635484 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635487 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635490 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635494 2578 flags.go:64] FLAG: --enable-server="true" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635496 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635501 2578 flags.go:64] FLAG: --event-burst="100" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635505 2578 flags.go:64] FLAG: --event-qps="50" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635507 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635511 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635514 2578 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635517 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635520 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635523 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635526 2578 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:01:44.640915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635529 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635531 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635535 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635538 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635541 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635544 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635547 2578 flags.go:64] FLAG: --feature-gates="" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635550 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635553 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635556 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635559 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635562 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635565 2578 flags.go:64] FLAG: --help="false" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635568 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-24.ec2.internal" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635571 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635574 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635577 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635580 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635583 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635586 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635590 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635592 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635595 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:01:44.641534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635598 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635601 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635604 2578 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635631 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635635 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635638 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635642 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635645 2578 flags.go:64] FLAG: --lock-file="" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635648 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635651 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635654 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635659 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635663 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635666 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635669 2578 flags.go:64] FLAG: --logging-format="text" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635672 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635675 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635678 2578 flags.go:64] FLAG: --manifest-url="" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635681 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635685 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635688 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635693 2578 flags.go:64] FLAG: --max-pods="110" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635696 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635698 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635701 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:01:44.642135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635704 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635707 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635711 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635713 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635724 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635727 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635730 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635733 2578 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635737 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635743 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635746 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635749 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635752 2578 flags.go:64] FLAG: --port="10250" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635755 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635758 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01d821b9aa5760197" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635761 2578 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635764 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635767 2578 flags.go:64] FLAG: --register-node="true" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635770 2578 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635774 2578 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635777 2578 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635780 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635783 2578 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635787 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635790 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:01:44.642814 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635793 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635795 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635798 2578 flags.go:64] FLAG: --runonce="false" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635801 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635804 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635808 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635810 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635813 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635816 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635819 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635822 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635825 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635831 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635833 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635836 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635844 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635847 2578 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635850 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635856 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635859 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635862 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635867 2578 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635869 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635872 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635875 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:01:44.643694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635879 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635882 2578 flags.go:64] FLAG: --v="2" Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635886 2578 flags.go:64] FLAG: --version="false" Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635890 2578 flags.go:64] FLAG: --vmodule="" Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635894 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.635897 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636019 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636022 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636026 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636028 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636031 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636034 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636038 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636041 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636045 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636048 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636051 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636054 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636057 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636062 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636065 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.644560 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636068 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636073 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636075 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636078 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636081 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636083 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636085 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636088 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636090 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636093 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636095 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636098 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636101 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636103 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636106 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636109 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636111 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636114 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636116 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.645102 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636119 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636121 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636124 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636126 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636128 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636131 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636133 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636136 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636139 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636141 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636144 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636148 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636151 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636153 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636157 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636160 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636163 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636165 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636168 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636170 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.645562 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636173 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636175 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636178 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636180 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636183 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636185 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636188 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636190 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636193 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636197 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636201 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636204 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636207 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636210 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636212 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636215 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636217 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636220 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636223 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636225 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.646072 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636227 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636230 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636232 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636236 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636239 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636241 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636247 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636251 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636253 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636256 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636259 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636261 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636264 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636266 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636269 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636271 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636274 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636276 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636279 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.646549 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636281 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636284 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636286 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636289 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636292 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.636294 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.637026 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.645733 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.645752 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.646461 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.646468 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646531 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646536 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646539 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646543 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.647020 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646546 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646549 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646553 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646556 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646564 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646568 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646571 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646574 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646576 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646579 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646583 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646586 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646588 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646591 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646593 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646596 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646599 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646602 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.647399 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646619 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646623 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646626 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646630 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646633 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646636 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646639 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646642 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646645 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646648 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646650 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646653 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646655 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646658 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646661 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646664 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646666 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646669 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646672 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646674 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.647887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646677 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646679 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646682 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646686 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646688 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646691 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646693 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646696 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646698 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646701 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646703 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646706 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646708 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646711 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646714 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646716 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646719 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646721 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646724 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.648363 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646726 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646729 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646732 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646734 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646736 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646739 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646741 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646744 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646747 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646749 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646752 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646754 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646757 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646761 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646765 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646768 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646771 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646774 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646777 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.648843 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646779 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646782 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646785 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646787 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646790 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646792 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646795 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646798 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646801 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646803 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646806 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646808 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646810 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646813 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646815 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646821 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.649297 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646823 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.646828 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646964 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646970 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646973 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646977 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646980 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646982 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646985 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646988 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646990 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646993 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646996 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.646999 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647002 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.649732 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647005 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647008 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647010 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647012 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647015 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647018 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647020 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647023 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647026 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647029 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647031 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647035 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647039 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647042 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647045 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647048 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647050 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647053 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647055 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.650099 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647058 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647060 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647063 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647066 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647068 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647071 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647073 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647076 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647079 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647081 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647084 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647086 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647089 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647092 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647094 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647097 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647100 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647102 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647106 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647108 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.650557 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647110 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647113 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647115 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647118 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647121 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647123 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647126 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647128 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647131 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647134 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647137 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647140 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647143 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647146 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647148 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647151 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647154 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647156 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647159 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647161 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.651052 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647164 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647166 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647169 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647172 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647174 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647177 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647180 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647182 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647185 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647190 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647193 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647195 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647198 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647200 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647203 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647205 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647208 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647210 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647212 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647215 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.651531 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647217 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647221 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647224 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647228 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647231 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647233 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:44.647236 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.647240 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.647368 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.649806 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.651274 2578 server.go:1019] "Starting client certificate rotation" Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.651377 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:01:44.652030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.651411 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:01:44.653933 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.653918 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:01:44.655264 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.655246 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:01:44.664021 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.664001 2578 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:01:44.668004 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.667985 2578 log.go:25] "Validated CRI v1 image API" Jul 29 15:01:44.669528 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.669510 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:01:44.672529 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.672508 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 93961df3-3267-41a7-bbe1-59a14144f1c5:/dev/nvme0n1p4 a4455463-2b97-41b0-8563-611d3d742ccc:/dev/nvme0n1p3] Jul 29 15:01:44.672599 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.672529 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:01:44.680071 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.679942 2578 manager.go:216] Machine: {Timestamp:2026-07-29 15:01:44.678257007 +0000 UTC m=+0.325340027 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29c868e83b367196d1236ace130dd8 SystemUUID:ec29c868-e83b-3671-96d1-236ace130dd8 BootID:3c32bd45-fdab-463a-a2c2-ad6edae57e95 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:d0:57:f8:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:d0:57:f8:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:7a:4c:40:da:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:01:44.680071 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.680055 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:01:44.680205 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.680190 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:01:44.681253 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.681238 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:01:44.683605 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.683569 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:01:44.683842 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.683690 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:01:44.684756 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.684741 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:01:44.684826 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.684760 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:01:44.684826 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.684770 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:01:44.685310 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.685296 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:01:44.686481 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.686467 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:01:44.688937 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.688920 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:01:44.689083 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689072 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:01:44.689143 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689112 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:01:44.689143 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689128 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:01:44.689229 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689147 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:01:44.689229 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689162 2578 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:01:44.689229 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689174 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:01:44.689578 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689563 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:01:44.689673 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.689586 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:01:44.691821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.691801 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:01:44.694083 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.694067 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:01:44.694142 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.694098 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:01:44.695959 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.695946 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:01:44.695959 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.695961 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.695970 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.695976 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.695985 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.695993 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.696004 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.696013 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.696024 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.696040 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:01:44.696051 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.696054 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:01:44.696275 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.696063 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:01:44.697441 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.697427 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:01:44.697485 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.697443 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:01:44.701048 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.701031 2578 server.go:1268] "Started kubelet" Jul 29 15:01:44.701482 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.701313 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:01:44.701482 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.701452 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:01:44.701482 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.701463 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:01:44.701482 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.701286 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:01:44.701736 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.701510 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:01:44.702125 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.702093 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:01:44.702133 ip-10-0-130-24 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:01:44.703829 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.703769 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:01:44.704045 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.704032 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:01:44.707747 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.706658 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-24.ec2.internal.18c6cad1caf4c74c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-24.ec2.internal,UID:ip-10-0-130-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-24.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.700995404 +0000 UTC m=+0.348078425,LastTimestamp:2026-07-29 15:01:44.700995404 +0000 UTC m=+0.348078425,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-24.ec2.internal,}" Jul 29 15:01:44.708112 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.708091 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:01:44.715300 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.715284 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:01:44.715385 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.715353 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:01:44.715478 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.715458 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:44.716109 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716036 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zt29j" Jul 29 15:01:44.716193 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716160 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:01:44.716193 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716164 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:01:44.716193 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716182 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:01:44.716359 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716345 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:01:44.716417 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716361 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:01:44.716486 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716468 2578 factory.go:55] Registering systemd factory Jul 29 15:01:44.716536 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716521 2578 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:01:44.716794 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716781 2578 factory.go:153] Registering CRI-O factory Jul 29 15:01:44.716850 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716797 2578 factory.go:223] Registration of the crio container factory successfully Jul 29 15:01:44.716850 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716846 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:01:44.716915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716871 2578 factory.go:103] Registering Raw factory Jul 29 15:01:44.716915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.716885 2578 manager.go:1196] Started watching for new ooms in manager Jul 29 15:01:44.717627 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.717597 2578 manager.go:349] Starting recovery of all containers Jul 29 15:01:44.727707 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.727657 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:01:44.727837 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.727777 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:01:44.730808 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.730784 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zt29j" Jul 29 15:01:44.731077 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.731058 2578 manager.go:354] Recovery completed Jul 29 15:01:44.736562 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.736542 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.738679 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.738660 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.738770 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.738714 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.738770 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.738728 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.739278 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.739259 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:01:44.739278 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.739276 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:01:44.739278 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.739280 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.739472 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.739292 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:01:44.740274 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.740259 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.740336 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.740289 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.740336 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.740303 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.741125 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.741112 2578 policy_none.go:49] "None policy: Start" Jul 29 15:01:44.741170 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.741129 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:01:44.741170 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.741140 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:01:44.741590 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.741514 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-24.ec2.internal.18c6cad1cd33c802 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-24.ec2.internal,UID:ip-10-0-130-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-24.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.738678786 +0000 UTC m=+0.385761809,LastTimestamp:2026-07-29 15:01:44.738678786 +0000 UTC m=+0.385761809,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-24.ec2.internal,}" Jul 29 15:01:44.742294 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.742281 2578 policy_none.go:47] "Start" Jul 29 15:01:44.787545 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.787320 2578 manager.go:337] "Starting Device Plugin manager" Jul 29 15:01:44.787664 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.787585 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:01:44.787664 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.787602 2578 server.go:87] "Starting device plugin registration server" Jul 29 15:01:44.787906 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.787892 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:01:44.787945 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.787910 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:01:44.788070 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.788049 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:01:44.788159 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.788147 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:01:44.788200 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.788160 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:01:44.788724 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.788700 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:01:44.788844 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.788757 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:44.889000 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.888884 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.890267 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.889996 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.890267 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.890027 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.890267 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.890038 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.890267 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.890066 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-24.ec2.internal" Jul 29 15:01:44.897504 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.897477 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-24.ec2.internal" Jul 29 15:01:44.897504 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.897505 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-24.ec2.internal\": node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:44.919907 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.919873 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:44.933703 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.933661 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:01:44.935017 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.934997 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:01:44.935098 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.935038 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:01:44.935098 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.935060 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:01:44.935098 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:44.935095 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:01:44.939794 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:44.939775 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.020783 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.020747 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:45.035686 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.035654 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal"] Jul 29 15:01:45.035764 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.035736 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:45.039228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.039207 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:45.039342 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.039248 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:45.039342 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.039266 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:45.040848 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.040835 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:45.040998 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.040982 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.041053 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041024 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:45.041792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041776 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:45.041792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041787 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:45.041927 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041803 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:45.041927 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041809 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:45.041927 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041813 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:45.041927 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.041830 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:45.043304 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.043285 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.043392 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.043328 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:45.044138 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.044119 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:45.044228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.044154 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:45.044228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.044169 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:45.063769 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.063740 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-24.ec2.internal\" not found" node="ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.068629 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.068608 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-24.ec2.internal\" not found" node="ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.119629 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.119598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c0f72c3273df0441814885d9a57b24-config\") pod \"kube-apiserver-proxy-ip-10-0-130-24.ec2.internal\" (UID: \"d1c0f72c3273df0441814885d9a57b24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.119773 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.119649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f0398ee9769d5dc6bdcf825568cae3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal\" (UID: \"a1f0398ee9769d5dc6bdcf825568cae3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.119773 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.119670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f0398ee9769d5dc6bdcf825568cae3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal\" (UID: \"a1f0398ee9769d5dc6bdcf825568cae3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.121815 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.121787 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:45.219982 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.219876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f0398ee9769d5dc6bdcf825568cae3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal\" (UID: \"a1f0398ee9769d5dc6bdcf825568cae3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.219982 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.219921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f0398ee9769d5dc6bdcf825568cae3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal\" (UID: \"a1f0398ee9769d5dc6bdcf825568cae3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.219982 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.219941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c0f72c3273df0441814885d9a57b24-config\") pod \"kube-apiserver-proxy-ip-10-0-130-24.ec2.internal\" (UID: \"d1c0f72c3273df0441814885d9a57b24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.219982 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.219960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f0398ee9769d5dc6bdcf825568cae3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal\" (UID: \"a1f0398ee9769d5dc6bdcf825568cae3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.219982 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.219976 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c0f72c3273df0441814885d9a57b24-config\") pod \"kube-apiserver-proxy-ip-10-0-130-24.ec2.internal\" (UID: \"d1c0f72c3273df0441814885d9a57b24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.220268 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.219993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f0398ee9769d5dc6bdcf825568cae3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal\" (UID: \"a1f0398ee9769d5dc6bdcf825568cae3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.222142 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.222126 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:45.322764 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.322724 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:45.368378 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.368338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.374319 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.374301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.423378 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.423351 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-24.ec2.internal\" not found" Jul 29 15:01:45.513569 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.513479 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.515587 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.515562 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.560819 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.560791 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:01:45.562899 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.562878 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" Jul 29 15:01:45.578731 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.578706 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:01:45.651176 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.651138 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:01:45.651775 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.651295 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:01:45.651775 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.651337 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:01:45.689341 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.689307 2578 apiserver.go:52] "Watching apiserver" Jul 29 15:01:45.708276 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.708251 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:01:45.708617 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.708595 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-p8x22","openshift-multus/network-metrics-daemon-xd8zr","openshift-network-operator/iptables-alerter-z8xpr","kube-system/global-pull-secret-syncer-kxdmt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms","openshift-image-registry/node-ca-5f5jh","openshift-multus/multus-7j5fl","openshift-network-diagnostics/network-check-target-svmx6","openshift-ovn-kubernetes/ovnkube-node-z84l6","kube-system/konnectivity-agent-xm7jr","kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wgktn","openshift-dns/node-resolver-sq7gn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal"] Jul 29 15:01:45.710420 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.710403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.711577 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.711555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.712759 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.712743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.712849 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.712806 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:45.713548 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.713529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.713660 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.713638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:01:45.714295 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.714278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.714829 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.714811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94cj2\"" Jul 29 15:01:45.714967 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.714902 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.714967 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.714934 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:01:45.715089 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.715033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:01:45.715221 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.715206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x42vx\"" Jul 29 15:01:45.715632 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.715618 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:01:45.715722 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.715698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.717150 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.717131 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.718419 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.718405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.719369 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.719355 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.719639 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.719626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:45.719697 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.719677 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:45.720969 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.720953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.721988 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.721969 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722513 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7hdt\"" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fec9098-a15b-4612-b7bf-c86bec53940e-dbus\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-system-cni-dir\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-cni-binary-copy\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722752 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f489d\" (UniqueName: \"kubernetes.io/projected/95f314eb-905b-4b6f-807e-3146c973e992-kube-api-access-f489d\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722881 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-socket-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.722807 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:01:45.723228 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.723055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-device-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hk2\" (UniqueName: \"kubernetes.io/projected/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-kube-api-access-w6hk2\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fec9098-a15b-4612-b7bf-c86bec53940e-kubelet-config\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-serviceca\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a7509ff-e248-4dcc-b8be-ba3c3415aa5a-konnectivity-ca\") pod \"konnectivity-agent-xm7jr\" (UID: \"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a\") " pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-host-slash\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p5w9j\"" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgg27\" (UniqueName: \"kubernetes.io/projected/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-kube-api-access-xgg27\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-os-release\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723880 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-host\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.723987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-cnibin\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.724020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxf86\" (UniqueName: \"kubernetes.io/projected/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-kube-api-access-mxf86\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.724069 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.724055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-registration-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.724924 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.724098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-sys-fs\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.724924 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.724129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-iptables-alerter-script\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.724924 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.724167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a7509ff-e248-4dcc-b8be-ba3c3415aa5a-agent-certs\") pod \"konnectivity-agent-xm7jr\" (UID: \"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a\") " pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.725542 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.725468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.727331 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.727308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.731968 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.731949 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:01:45.732046 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.731956 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.732818 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.732794 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:01:45.732920 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.732804 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:01:45.732920 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.732864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.735915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.735896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:01:45.736425 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xq6f7\"" Jul 29 15:01:45.736704 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jhtdf\"" Jul 29 15:01:45.736788 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736719 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:01:45.736788 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736733 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-phm78\"" Jul 29 15:01:45.736909 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736789 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hlj25\"" Jul 29 15:01:45.736909 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736818 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:01:45.736909 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736831 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 14:56:44 +0000 UTC" deadline="2028-03-26 22:12:27.859657942 +0000 UTC" Jul 29 15:01:45.736909 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736873 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14551h10m42.122788261s" Jul 29 15:01:45.737097 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.737097 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.736955 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.737156 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.737130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:01:45.737205 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.737153 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.737205 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.737153 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.737205 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.737193 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.737325 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.737209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wl77f\"" Jul 29 15:01:45.737325 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.737297 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.747959 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.747933 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:01:45.773873 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.773847 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9pb8r" Jul 29 15:01:45.786370 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.786348 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9pb8r" Jul 29 15:01:45.817572 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.817548 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:01:45.824538 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-kubelet\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.824680 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af26be2-1734-4613-b5e9-a0252bc4bdac-tmp-dir\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.824680 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hf2h\" (UniqueName: \"kubernetes.io/projected/2af26be2-1734-4613-b5e9-a0252bc4bdac-kube-api-access-2hf2h\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.824680 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysctl-conf\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.824680 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-tuned\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.824680 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-systemd-units\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-host\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-cnibin\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxf86\" (UniqueName: \"kubernetes.io/projected/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-kube-api-access-mxf86\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-etc-kubernetes\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-run\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-host\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-sys-fs\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-iptables-alerter-script\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824850 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-cnibin\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-os-release\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824920 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-sys-fs\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.824953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-kubernetes\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-var-lib-kubelet\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.824983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f2f-d914-406b-849e-022b4387f49a-tmp\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-var-lib-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-cnibin\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-modprobe-d\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-env-overrides\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fec9098-a15b-4612-b7bf-c86bec53940e-dbus\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-system-cni-dir\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-cni-binary-copy\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825239 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-system-cni-dir\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-k8s-cni-cncf-io\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-cni-bin\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fec9098-a15b-4612-b7bf-c86bec53940e-dbus\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-ovn\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.825526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825418 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-iptables-alerter-script\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-socket-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-device-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-device-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hk2\" (UniqueName: \"kubernetes.io/projected/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-kube-api-access-w6hk2\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fec9098-a15b-4612-b7bf-c86bec53940e-kubelet-config\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825585 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-socket-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-kubelet\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-run-netns\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fec9098-a15b-4612-b7bf-c86bec53940e-kubelet-config\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-run-ovn-kubernetes\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-socket-dir-parent\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-multus-certs\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovn-node-metrics-cert\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.826379 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgg27\" (UniqueName: \"kubernetes.io/projected/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-kube-api-access-xgg27\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-cni-binary-copy\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-os-release\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-cni-bin\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovnkube-config\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95f314eb-905b-4b6f-807e-3146c973e992-os-release\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovnkube-script-lib\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.825996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-daemon-config\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysctl-d\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.826026 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-node-log\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-system-cni-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827155 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.826123 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.326101595 +0000 UTC m=+1.973184606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-cni-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-netns\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-slash\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-registration-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-systemd\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-registration-dir\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-cni-multus\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-conf-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-lib-modules\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-etc-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7cc\" (UniqueName: \"kubernetes.io/projected/07a172b9-6c88-4b01-b8cd-e32c6524205d-kube-api-access-jf7cc\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2af26be2-1734-4613-b5e9-a0252bc4bdac-hosts-file\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a7509ff-e248-4dcc-b8be-ba3c3415aa5a-agent-certs\") pod \"konnectivity-agent-xm7jr\" (UID: \"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a\") " pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f489d\" (UniqueName: \"kubernetes.io/projected/95f314eb-905b-4b6f-807e-3146c973e992-kube-api-access-f489d\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-cni-binary-copy\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.827922 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-hostroot\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dsdb\" (UniqueName: \"kubernetes.io/projected/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-kube-api-access-6dsdb\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysconfig\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-systemd\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kprx\" (UniqueName: \"kubernetes.io/projected/cd920715-09e0-4206-aac2-0e412a5ec171-kube-api-access-8kprx\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-sys\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-host\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j7cq\" (UniqueName: \"kubernetes.io/projected/3a6d9f2f-d914-406b-849e-022b4387f49a-kube-api-access-5j7cq\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-log-socket\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826846 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-serviceca\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a7509ff-e248-4dcc-b8be-ba3c3415aa5a-konnectivity-ca\") pod \"konnectivity-agent-xm7jr\" (UID: \"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a\") " pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.826982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-host-slash\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:45.828730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-cni-netd\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.829590 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-host-slash\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.829590 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.829590 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-serviceca\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.829590 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827545 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a7509ff-e248-4dcc-b8be-ba3c3415aa5a-konnectivity-ca\") pod \"konnectivity-agent-xm7jr\" (UID: \"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a\") " pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.829590 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.827629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95f314eb-905b-4b6f-807e-3146c973e992-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.830821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.830803 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a7509ff-e248-4dcc-b8be-ba3c3415aa5a-agent-certs\") pod \"konnectivity-agent-xm7jr\" (UID: \"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a\") " pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:45.844969 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.844933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgg27\" (UniqueName: \"kubernetes.io/projected/270e426a-fe2a-414a-8d2b-e2db7bc7f0ec-kube-api-access-xgg27\") pod \"node-ca-5f5jh\" (UID: \"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec\") " pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:45.852642 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.852608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hk2\" (UniqueName: \"kubernetes.io/projected/f2ef3834-c70e-4d5f-8564-fb09ca5070ae-kube-api-access-w6hk2\") pod \"aws-ebs-csi-driver-node-24rms\" (UID: \"f2ef3834-c70e-4d5f-8564-fb09ca5070ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:45.852642 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.852635 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxf86\" (UniqueName: \"kubernetes.io/projected/9a9dbc14-60c8-4698-a2e2-575a4d02f1ee-kube-api-access-mxf86\") pod \"iptables-alerter-z8xpr\" (UID: \"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee\") " pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:45.858285 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.858259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f489d\" (UniqueName: \"kubernetes.io/projected/95f314eb-905b-4b6f-807e-3146c973e992-kube-api-access-f489d\") pod \"multus-additional-cni-plugins-p8x22\" (UID: \"95f314eb-905b-4b6f-807e-3146c973e992\") " pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:45.928352 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-multus-certs\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.928352 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovn-node-metrics-cert\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-cni-bin\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-cni-bin\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-multus-certs\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovnkube-config\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovnkube-script-lib\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-daemon-config\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysctl-d\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-node-log\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-system-cni-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-cni-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.928678 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-netns\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928670 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-node-log\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-slash\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-slash\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928745 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysctl-d\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-systemd\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928802 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-system-cni-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928808 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-systemd\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928839 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-netns\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-cni-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-cni-multus\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-conf-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-lib-modules\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-etc-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7cc\" (UniqueName: \"kubernetes.io/projected/07a172b9-6c88-4b01-b8cd-e32c6524205d-kube-api-access-jf7cc\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928982 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-conf-dir\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.928978 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-cni-multus\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2af26be2-1734-4613-b5e9-a0252bc4bdac-hosts-file\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.929250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-etc-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-cni-binary-copy\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-hostroot\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dsdb\" (UniqueName: \"kubernetes.io/projected/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-kube-api-access-6dsdb\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysconfig\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2af26be2-1734-4613-b5e9-a0252bc4bdac-hosts-file\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-systemd\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kprx\" (UniqueName: \"kubernetes.io/projected/cd920715-09e0-4206-aac2-0e412a5ec171-kube-api-access-8kprx\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929252 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovnkube-config\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-sys\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929136 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-lib-modules\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovnkube-script-lib\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-host\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysconfig\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j7cq\" (UniqueName: \"kubernetes.io/projected/3a6d9f2f-d914-406b-849e-022b4387f49a-kube-api-access-5j7cq\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-systemd\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.930260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-log-socket\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929436 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-daemon-config\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-sys\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929502 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-log-socket\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-cni-netd\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929559 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-host\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-kubelet\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929584 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-hostroot\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.929604 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af26be2-1734-4613-b5e9-a0252bc4bdac-tmp-dir\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-kubelet\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.929846 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.429824414 +0000 UTC m=+2.076907441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hf2h\" (UniqueName: \"kubernetes.io/projected/2af26be2-1734-4613-b5e9-a0252bc4bdac-kube-api-access-2hf2h\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.931201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysctl-conf\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-tuned\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.929983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-systemd-units\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-etc-kubernetes\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-run\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-os-release\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-kubernetes\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-cni-binary-copy\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-var-lib-kubelet\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f2f-d914-406b-849e-022b4387f49a-tmp\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-var-lib-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-cni-netd\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-cnibin\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-modprobe-d\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-kubernetes\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-env-overrides\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-k8s-cni-cncf-io\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930355 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-var-lib-kubelet\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-cni-bin\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-ovn\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-var-lib-cni-bin\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-os-release\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-run\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-modprobe-d\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930146 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af26be2-1734-4613-b5e9-a0252bc4bdac-tmp-dir\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-etc-kubernetes\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-systemd-units\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930573 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-cnibin\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-kubelet\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-host-run-k8s-cni-cncf-io\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-var-lib-openvswitch\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930663 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-kubelet\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930663 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-run-ovn\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-run-netns\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-run-ovn-kubernetes\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-socket-dir-parent\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.932655 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-sysctl-conf\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-run-ovn-kubernetes\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-multus-socket-dir-parent\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07a172b9-6c88-4b01-b8cd-e32c6524205d-host-run-netns\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.930976 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07a172b9-6c88-4b01-b8cd-e32c6524205d-env-overrides\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.931423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07a172b9-6c88-4b01-b8cd-e32c6524205d-ovn-node-metrics-cert\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.932680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f2f-d914-406b-849e-022b4387f49a-etc-tuned\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.933250 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.932914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f2f-d914-406b-849e-022b4387f49a-tmp\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.954740 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.954400 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:45.954740 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.954431 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:45.954740 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.954446 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:45.954740 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:45.954519 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.454498317 +0000 UTC m=+2.101581355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:45.955083 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.955059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7cc\" (UniqueName: \"kubernetes.io/projected/07a172b9-6c88-4b01-b8cd-e32c6524205d-kube-api-access-jf7cc\") pod \"ovnkube-node-z84l6\" (UID: \"07a172b9-6c88-4b01-b8cd-e32c6524205d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:45.955151 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.955136 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j7cq\" (UniqueName: \"kubernetes.io/projected/3a6d9f2f-d914-406b-849e-022b4387f49a-kube-api-access-5j7cq\") pod \"tuned-wgktn\" (UID: \"3a6d9f2f-d914-406b-849e-022b4387f49a\") " pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:45.956294 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.956273 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dsdb\" (UniqueName: \"kubernetes.io/projected/be38e6a0-12dc-4fcc-ad39-d1033bd0bce0-kube-api-access-6dsdb\") pod \"multus-7j5fl\" (UID: \"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0\") " pod="openshift-multus/multus-7j5fl" Jul 29 15:01:45.956387 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.956324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hf2h\" (UniqueName: \"kubernetes.io/projected/2af26be2-1734-4613-b5e9-a0252bc4bdac-kube-api-access-2hf2h\") pod \"node-resolver-sq7gn\" (UID: \"2af26be2-1734-4613-b5e9-a0252bc4bdac\") " pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:45.956637 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.956615 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kprx\" (UniqueName: \"kubernetes.io/projected/cd920715-09e0-4206-aac2-0e412a5ec171-kube-api-access-8kprx\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:45.989040 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:45.989001 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c0f72c3273df0441814885d9a57b24.slice/crio-6915ced6f7155ef03a27db615bf0a0ab8decfcd49af2a49261603ab474c59f74 WatchSource:0}: Error finding container 6915ced6f7155ef03a27db615bf0a0ab8decfcd49af2a49261603ab474c59f74: Status 404 returned error can't find the container with id 6915ced6f7155ef03a27db615bf0a0ab8decfcd49af2a49261603ab474c59f74 Jul 29 15:01:45.989541 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:45.989510 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f0398ee9769d5dc6bdcf825568cae3.slice/crio-e840b5769e2c98aa5cfdcfe1ef681b9213accbd925c7f8720e5195c511f6c13c WatchSource:0}: Error finding container e840b5769e2c98aa5cfdcfe1ef681b9213accbd925c7f8720e5195c511f6c13c: Status 404 returned error can't find the container with id e840b5769e2c98aa5cfdcfe1ef681b9213accbd925c7f8720e5195c511f6c13c Jul 29 15:01:45.994856 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:45.994839 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:01:46.000534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.000515 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:46.036694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.036602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" Jul 29 15:01:46.044887 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.044861 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ef3834_c70e_4d5f_8564_fb09ca5070ae.slice/crio-d2517263af15ade40dbcf07770b5e850b76258d8c947f3a71f5a47fc0f7fb25a WatchSource:0}: Error finding container d2517263af15ade40dbcf07770b5e850b76258d8c947f3a71f5a47fc0f7fb25a: Status 404 returned error can't find the container with id d2517263af15ade40dbcf07770b5e850b76258d8c947f3a71f5a47fc0f7fb25a Jul 29 15:01:46.050124 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.050105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:01:46.057036 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.057015 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7509ff_e248_4dcc_b8be_ba3c3415aa5a.slice/crio-a15337a5b95b1c21a2a557a20cfb739109ed07946aa4daa9c3e35e1ca455467e WatchSource:0}: Error finding container a15337a5b95b1c21a2a557a20cfb739109ed07946aa4daa9c3e35e1ca455467e: Status 404 returned error can't find the container with id a15337a5b95b1c21a2a557a20cfb739109ed07946aa4daa9c3e35e1ca455467e Jul 29 15:01:46.070691 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.070670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p8x22" Jul 29 15:01:46.077714 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.077690 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f314eb_905b_4b6f_807e_3146c973e992.slice/crio-a042be14a3e583d9e0c60be0343ea7646aa485838f6fbe194a066c64c0a9798d WatchSource:0}: Error finding container a042be14a3e583d9e0c60be0343ea7646aa485838f6fbe194a066c64c0a9798d: Status 404 returned error can't find the container with id a042be14a3e583d9e0c60be0343ea7646aa485838f6fbe194a066c64c0a9798d Jul 29 15:01:46.083755 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.083733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8xpr" Jul 29 15:01:46.090404 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.090376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5f5jh" Jul 29 15:01:46.090659 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.090621 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9dbc14_60c8_4698_a2e2_575a4d02f1ee.slice/crio-b315f6c8894781b2bc255e1f7a0dc744f386568fab23828d9510103f47df6f80 WatchSource:0}: Error finding container b315f6c8894781b2bc255e1f7a0dc744f386568fab23828d9510103f47df6f80: Status 404 returned error can't find the container with id b315f6c8894781b2bc255e1f7a0dc744f386568fab23828d9510103f47df6f80 Jul 29 15:01:46.097888 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.097862 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270e426a_fe2a_414a_8d2b_e2db7bc7f0ec.slice/crio-b48953f6b9dd3eca9910358bc4c43d83e5f9255c769aa36045494116b4f1efce WatchSource:0}: Error finding container b48953f6b9dd3eca9910358bc4c43d83e5f9255c769aa36045494116b4f1efce: Status 404 returned error can't find the container with id b48953f6b9dd3eca9910358bc4c43d83e5f9255c769aa36045494116b4f1efce Jul 29 15:01:46.120130 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.120099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7j5fl" Jul 29 15:01:46.127288 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.127260 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe38e6a0_12dc_4fcc_ad39_d1033bd0bce0.slice/crio-bb5e3df908a1fb13c7a745066db66f79da9f8b6f75bf9a87ecc1140b6b70e86d WatchSource:0}: Error finding container bb5e3df908a1fb13c7a745066db66f79da9f8b6f75bf9a87ecc1140b6b70e86d: Status 404 returned error can't find the container with id bb5e3df908a1fb13c7a745066db66f79da9f8b6f75bf9a87ecc1140b6b70e86d Jul 29 15:01:46.129125 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.129106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:01:46.136335 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.136312 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a172b9_6c88_4b01_b8cd_e32c6524205d.slice/crio-3c1a90d5c4b34f381b1a1c9a5e1438bc0d2df972edf29fec620cbd6f90fbc21c WatchSource:0}: Error finding container 3c1a90d5c4b34f381b1a1c9a5e1438bc0d2df972edf29fec620cbd6f90fbc21c: Status 404 returned error can't find the container with id 3c1a90d5c4b34f381b1a1c9a5e1438bc0d2df972edf29fec620cbd6f90fbc21c Jul 29 15:01:46.138904 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.138884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgktn" Jul 29 15:01:46.145415 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.145398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sq7gn" Jul 29 15:01:46.145930 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.145910 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6d9f2f_d914_406b_849e_022b4387f49a.slice/crio-6e802f0f504211a4b4748c2d5f0838bcb1277869c296c8aeceed5544220a1f6b WatchSource:0}: Error finding container 6e802f0f504211a4b4748c2d5f0838bcb1277869c296c8aeceed5544220a1f6b: Status 404 returned error can't find the container with id 6e802f0f504211a4b4748c2d5f0838bcb1277869c296c8aeceed5544220a1f6b Jul 29 15:01:46.152504 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:01:46.152480 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af26be2_1734_4613_b5e9_a0252bc4bdac.slice/crio-ffbcc4324c01ea2e3a201d7313f2fe64125b12efb1753bba1196e12fa070726e WatchSource:0}: Error finding container ffbcc4324c01ea2e3a201d7313f2fe64125b12efb1753bba1196e12fa070726e: Status 404 returned error can't find the container with id ffbcc4324c01ea2e3a201d7313f2fe64125b12efb1753bba1196e12fa070726e Jul 29 15:01:46.154064 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.154041 2578 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-sq7gn_openshift-dns(2af26be2-1734-4613-b5e9-a0252bc4bdac): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 29 15:01:46.154127 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.154081 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-sq7gn" podUID="2af26be2-1734-4613-b5e9-a0252bc4bdac" Jul 29 15:01:46.208247 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.208220 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:46.333177 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.333079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:46.333352 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.333244 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:46.333352 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.333327 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:01:47.333307506 +0000 UTC m=+2.980390516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:46.434430 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.434391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:46.434595 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.434511 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:46.434595 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.434563 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:47.434549293 +0000 UTC m=+3.081632304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:46.534944 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.534911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:46.535161 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.535140 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:46.535244 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.535169 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:46.535244 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.535182 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.535345 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.535251 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:47.535230687 +0000 UTC m=+3.182313709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.788554 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.788440 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:56:45 +0000 UTC" deadline="2028-03-07 20:34:47.457793939 +0000 UTC" Jul 29 15:01:46.788554 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.788505 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14093h33m0.669293604s" Jul 29 15:01:46.915333 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.915297 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:46.936759 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.936730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:46.936759 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.936752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:46.936994 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.936917 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:46.936994 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.936964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:46.946592 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.946117 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sq7gn" event={"ID":"2af26be2-1734-4613-b5e9-a0252bc4bdac","Type":"ContainerStarted","Data":"ffbcc4324c01ea2e3a201d7313f2fe64125b12efb1753bba1196e12fa070726e"} Jul 29 15:01:46.948962 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:46.948932 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-sq7gn" podUID="2af26be2-1734-4613-b5e9-a0252bc4bdac" Jul 29 15:01:46.958663 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.958632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8xpr" event={"ID":"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee","Type":"ContainerStarted","Data":"b315f6c8894781b2bc255e1f7a0dc744f386568fab23828d9510103f47df6f80"} Jul 29 15:01:46.971165 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.970897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerStarted","Data":"a042be14a3e583d9e0c60be0343ea7646aa485838f6fbe194a066c64c0a9798d"} Jul 29 15:01:46.990528 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.990491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xm7jr" event={"ID":"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a","Type":"ContainerStarted","Data":"a15337a5b95b1c21a2a557a20cfb739109ed07946aa4daa9c3e35e1ca455467e"} Jul 29 15:01:46.995743 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:46.995710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgktn" event={"ID":"3a6d9f2f-d914-406b-849e-022b4387f49a","Type":"ContainerStarted","Data":"6e802f0f504211a4b4748c2d5f0838bcb1277869c296c8aeceed5544220a1f6b"} Jul 29 15:01:47.007517 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.007474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"3c1a90d5c4b34f381b1a1c9a5e1438bc0d2df972edf29fec620cbd6f90fbc21c"} Jul 29 15:01:47.021752 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.021713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7j5fl" event={"ID":"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0","Type":"ContainerStarted","Data":"bb5e3df908a1fb13c7a745066db66f79da9f8b6f75bf9a87ecc1140b6b70e86d"} Jul 29 15:01:47.040742 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.040656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5f5jh" event={"ID":"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec","Type":"ContainerStarted","Data":"b48953f6b9dd3eca9910358bc4c43d83e5f9255c769aa36045494116b4f1efce"} Jul 29 15:01:47.063622 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.063570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" event={"ID":"f2ef3834-c70e-4d5f-8564-fb09ca5070ae","Type":"ContainerStarted","Data":"d2517263af15ade40dbcf07770b5e850b76258d8c947f3a71f5a47fc0f7fb25a"} Jul 29 15:01:47.076932 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.076845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" event={"ID":"a1f0398ee9769d5dc6bdcf825568cae3","Type":"ContainerStarted","Data":"e840b5769e2c98aa5cfdcfe1ef681b9213accbd925c7f8720e5195c511f6c13c"} Jul 29 15:01:47.078500 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.078434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" event={"ID":"d1c0f72c3273df0441814885d9a57b24","Type":"ContainerStarted","Data":"6915ced6f7155ef03a27db615bf0a0ab8decfcd49af2a49261603ab474c59f74"} Jul 29 15:01:47.342070 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.341976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:47.342238 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.342173 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:47.342301 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.342248 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:01:49.34222968 +0000 UTC m=+4.989312692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:47.443376 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.443336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:47.443555 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.443478 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:47.443555 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.443540 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:49.443521222 +0000 UTC m=+5.090604245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:47.526728 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.526479 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:47.544099 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.544063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:47.544297 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.544229 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:47.544297 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.544248 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:47.544297 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.544261 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:47.544449 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.544316 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:49.544298813 +0000 UTC m=+5.191381825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:47.790056 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.789932 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:56:45 +0000 UTC" deadline="2028-05-04 18:24:15.97101589 +0000 UTC" Jul 29 15:01:47.790056 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.789972 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15483h22m28.181050201s" Jul 29 15:01:47.935289 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:47.935251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:47.935470 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:47.935383 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:48.938438 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:48.938364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:48.938904 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:48.938494 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:48.938966 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:48.938955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:48.939079 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:48.939048 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:49.369662 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:49.369620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:49.369851 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.369761 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:49.369851 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.369825 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:01:53.369807753 +0000 UTC m=+9.016890776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:49.470873 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:49.470796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:49.471107 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.470979 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:49.471107 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.471094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:53.471070274 +0000 UTC m=+9.118153300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:49.572013 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:49.571970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:49.572165 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.572141 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:49.572165 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.572162 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:49.572231 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.572174 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:49.572267 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.572233 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:53.572215081 +0000 UTC m=+9.219298100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:49.936074 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:49.935703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:49.936074 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:49.935866 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:50.935991 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:50.935956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:50.936454 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:50.935956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:50.936454 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:50.936115 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:50.936454 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:50.936206 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:51.936168 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:51.936126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:51.936555 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:51.936289 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:52.936368 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:52.935904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:52.936368 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:52.935870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:52.936368 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:52.936036 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:52.936368 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:52.936160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:53.404904 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:53.404781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:53.405109 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.404997 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:53.405109 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.405061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:02:01.405042306 +0000 UTC m=+17.052125330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:53.505888 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:53.505850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:53.506192 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.506168 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:53.506279 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.506252 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:01.506230548 +0000 UTC m=+17.153313576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:53.607241 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:53.607200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:53.607486 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.607447 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:53.607486 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.607477 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:53.607486 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.607490 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:53.607743 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.607554 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:02:01.607535846 +0000 UTC m=+17.254618856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:53.935892 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:53.935860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:53.936058 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:53.936008 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:54.936493 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:54.936456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:54.936970 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:54.936573 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:54.936970 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:54.936656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:54.936970 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:54.936731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:55.935241 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:55.935208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:55.935432 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:55.935322 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:56.935712 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:56.935448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:56.936158 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:56.935448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:56.936158 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:56.935831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:56.936158 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:56.935875 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:57.935876 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:57.935831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:57.936274 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:57.936099 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:01:58.935437 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:58.935398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:01:58.935650 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:58.935527 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:01:58.935650 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:58.935585 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:01:58.935768 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:58.935720 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:01:59.936249 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:01:59.936216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:01:59.936721 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:01:59.936327 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:00.935898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:00.935864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:00.936095 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:00.936002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:00.936095 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:00.936060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:00.936216 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:00.936172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:01.467840 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:01.467803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:01.468293 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.467976 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:01.468293 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.468057 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.468035806 +0000 UTC m=+33.115118819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:01.568961 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:01.568918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:01.569143 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.569041 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:01.569143 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.569114 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.569093713 +0000 UTC m=+33.216176729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:01.670301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:01.670260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:01.670495 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.670483 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:02:01.670555 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.670502 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:02:01.670555 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.670512 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:01.670667 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.670577 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.670558622 +0000 UTC m=+33.317641630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:01.935823 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:01.935744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:01.936069 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:01.935854 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:02.935432 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:02.935401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:02.935928 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:02.935531 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:02.935928 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:02.935591 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:02.935928 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:02.935722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:03.935352 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:03.935317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:03.935530 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:03.935438 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:04.936780 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:04.936745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:04.937199 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:04.936844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:04.937199 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:04.936896 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:04.937199 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:04.937016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:05.936226 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:05.935996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:05.936392 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:05.936360 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:06.127670 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.127639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" event={"ID":"d1c0f72c3273df0441814885d9a57b24","Type":"ContainerStarted","Data":"a1b5ae50d76739c1c1024fe6643fbe82a248c8e70d9c300c5e03eab40d2e8431"} Jul 29 15:02:06.129177 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.129155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sq7gn" event={"ID":"2af26be2-1734-4613-b5e9-a0252bc4bdac","Type":"ContainerStarted","Data":"43ccadb0ceda2c2f812f3a5e9037bf2137145713920615fd29a849c7286b69f6"} Jul 29 15:02:06.130721 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.130695 2578 generic.go:356] "Generic (PLEG): container finished" podID="95f314eb-905b-4b6f-807e-3146c973e992" containerID="b31530f758902d5b9452658d4e9d6af91bb8ba07bce4b3f51c8dc8983664159d" exitCode=0 Jul 29 15:02:06.130793 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.130767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerDied","Data":"b31530f758902d5b9452658d4e9d6af91bb8ba07bce4b3f51c8dc8983664159d"} Jul 29 15:02:06.132303 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.132273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xm7jr" event={"ID":"6a7509ff-e248-4dcc-b8be-ba3c3415aa5a","Type":"ContainerStarted","Data":"d7e067c3bb0207d1618eefadb21cfdc82c1244d465c650bde61d68806603180d"} Jul 29 15:02:06.133904 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.133884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgktn" event={"ID":"3a6d9f2f-d914-406b-849e-022b4387f49a","Type":"ContainerStarted","Data":"3c24fcad0d312c466a0b1e28ab8a1f11c31a0a4402a7acd7be57c93699a9770c"} Jul 29 15:02:06.136123 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.136095 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"ea99251367de3bda038aca724ead199f116840561cbf2f6c6d313d24ce94f6da"} Jul 29 15:02:06.136223 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.136166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"6a59bf9785fa45621f0cb991b2ea625b4220732e858498121f50f1fb1499e89c"} Jul 29 15:02:06.136223 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.136217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"7f378f83fd312478f897a2e85bf9e610f426be09fee15a2a1c229461352874dc"} Jul 29 15:02:06.137660 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.137639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7j5fl" event={"ID":"be38e6a0-12dc-4fcc-ad39-d1033bd0bce0","Type":"ContainerStarted","Data":"c31332ecc7783850807b7ed811ca1d54c120b5f6ab57d179d02f957f8d067a73"} Jul 29 15:02:06.139043 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.139021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5f5jh" event={"ID":"270e426a-fe2a-414a-8d2b-e2db7bc7f0ec","Type":"ContainerStarted","Data":"4a3c2151abca526b05150ec944ad96814f4a59a16d15678159dcec335ef9e795"} Jul 29 15:02:06.140284 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.140265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" event={"ID":"f2ef3834-c70e-4d5f-8564-fb09ca5070ae","Type":"ContainerStarted","Data":"85032f4a5d6aae60c8a50335d06b8c251746e24608ea3157fd8cd08eaa6aaecb"} Jul 29 15:02:06.141540 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.141520 2578 generic.go:356] "Generic (PLEG): container finished" podID="a1f0398ee9769d5dc6bdcf825568cae3" containerID="4a88795793779f7afaef4a11440da06ab04dabb861b7968aa7e867add4b56a8a" exitCode=0 Jul 29 15:02:06.141633 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.141550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" event={"ID":"a1f0398ee9769d5dc6bdcf825568cae3","Type":"ContainerDied","Data":"4a88795793779f7afaef4a11440da06ab04dabb861b7968aa7e867add4b56a8a"} Jul 29 15:02:06.142159 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.142118 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-24.ec2.internal" podStartSLOduration=21.142105972 podStartE2EDuration="21.142105972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.141553107 +0000 UTC m=+21.788636141" watchObservedRunningTime="2026-07-29 15:02:06.142105972 +0000 UTC m=+21.789189001" Jul 29 15:02:06.176880 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.176836 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5f5jh" podStartSLOduration=1.855325992 podStartE2EDuration="21.176820335s" totalImagesPullingTime="19.321494343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.156915267 +0000 UTC m=+21.803998297" watchObservedRunningTime="2026-07-29 15:02:06.176820335 +0000 UTC m=+21.823903420" Jul 29 15:02:06.177026 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.176910 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7j5fl" podStartSLOduration=1.860671289 podStartE2EDuration="21.176906322s" totalImagesPullingTime="19.316235033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.176656849 +0000 UTC m=+21.823739878" watchObservedRunningTime="2026-07-29 15:02:06.176906322 +0000 UTC m=+21.823989351" Jul 29 15:02:06.200117 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.199952 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgktn" podStartSLOduration=2.192817239 podStartE2EDuration="21.199938363s" totalImagesPullingTime="19.007121124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.199089407 +0000 UTC m=+21.846172437" watchObservedRunningTime="2026-07-29 15:02:06.199938363 +0000 UTC m=+21.847021393" Jul 29 15:02:06.225026 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.224982 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sq7gn" podStartSLOduration=1.932866996 podStartE2EDuration="21.224964111s" totalImagesPullingTime="19.292097115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-29 15:02:06.224578702 +0000 UTC m=+21.871661732" watchObservedRunningTime="2026-07-29 15:02:06.224964111 +0000 UTC m=+21.872047140" Jul 29 15:02:06.254237 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.254198 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xm7jr" podStartSLOduration=3.006300976 podStartE2EDuration="22.254181928s" totalImagesPullingTime="19.247880952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.254092896 +0000 UTC m=+21.901175925" watchObservedRunningTime="2026-07-29 15:02:06.254181928 +0000 UTC m=+21.901264957" Jul 29 15:02:06.935367 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.935334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:06.935534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:06.935334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:06.935534 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:06.935467 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:06.935797 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:06.935765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:07.146116 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.146018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8xpr" event={"ID":"9a9dbc14-60c8-4698-a2e2-575a4d02f1ee","Type":"ContainerStarted","Data":"6f881e0bb0d3ae987de2019bd3820d73a780e4b73cc789787b115bc45e467a4b"} Jul 29 15:02:07.150376 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.150264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"0c0ce921346cd53e4dac4d80037e7223f7bed9d94943d797cd2fbd5a7921af2f"} Jul 29 15:02:07.150376 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.150358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"49a49d2c624a10d789eb3148435b00bc335564dde0e87a3f45d23306a6f2763f"} Jul 29 15:02:07.150572 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.150411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"bd15a1c51efef1a198abcd1c2f0788696eb3fcdd398b1b21f24b36cb2fcce4b7"} Jul 29 15:02:07.164899 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.164853 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z8xpr" podStartSLOduration=3.102643583 podStartE2EDuration="22.164838076s" totalImagesPullingTime="19.062194493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.16448317 +0000 UTC m=+22.811566199" watchObservedRunningTime="2026-07-29 15:02:07.164838076 +0000 UTC m=+22.811921104" Jul 29 15:02:07.424790 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.424730 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:02:07.526102 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.526071 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:02:07.526644 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.526601 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:02:07.801662 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.801501 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:02:07.424752622Z","UUID":"0633f1d9-d610-4a17-8b3b-45f657249700","Handler":null,"Name":"","Endpoint":""} Jul 29 15:02:07.803199 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.803171 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:02:07.803318 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.803217 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:02:07.935497 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:07.935469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:07.935690 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:07.935581 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:08.154923 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.154841 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" event={"ID":"f2ef3834-c70e-4d5f-8564-fb09ca5070ae","Type":"ContainerStarted","Data":"beeddeb1d60bd217d111c730d0a6e0d39bbe5a680790f0660f9bb1a45a573324"} Jul 29 15:02:08.156846 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.156816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" event={"ID":"a1f0398ee9769d5dc6bdcf825568cae3","Type":"ContainerStarted","Data":"23ec67547945f45079da8ad1d12dcf19801c5bad34121af0249234437d29df0c"} Jul 29 15:02:08.157349 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.157300 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:02:08.157653 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.157636 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xm7jr" Jul 29 15:02:08.173245 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.173189 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-24.ec2.internal" podStartSLOduration=23.17317276 podStartE2EDuration="23.17317276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:08.172976269 +0000 UTC m=+23.820059300" watchObservedRunningTime="2026-07-29 15:02:08.17317276 +0000 UTC m=+23.820255788" Jul 29 15:02:08.935901 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.935871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:08.936091 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:08.935989 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:08.936091 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:08.936046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:08.936213 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:08.936162 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:09.166387 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:09.166353 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"013d6c15100d75b6e19943e5f6e03abffbf078cef883154b40258ff990ba22a7"} Jul 29 15:02:09.935883 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:09.935847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:09.936076 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:09.935991 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:10.935500 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:10.935467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:10.936288 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:10.935575 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:10.936288 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:10.935627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:10.936288 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:10.935715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:11.171598 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.171523 2578 generic.go:356] "Generic (PLEG): container finished" podID="95f314eb-905b-4b6f-807e-3146c973e992" containerID="0e07ebbb16198672b93b65cffab98849190a2feff07b7d37399057fbbe75667b" exitCode=0 Jul 29 15:02:11.171758 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.171635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerDied","Data":"0e07ebbb16198672b93b65cffab98849190a2feff07b7d37399057fbbe75667b"} Jul 29 15:02:11.175278 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.175257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" event={"ID":"07a172b9-6c88-4b01-b8cd-e32c6524205d","Type":"ContainerStarted","Data":"7c0768e75d4da164e43a8672ace7ae9d8181a39cded2f4e6e0b97b750877fbd0"} Jul 29 15:02:11.175512 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.175486 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:02:11.177755 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.177734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" event={"ID":"f2ef3834-c70e-4d5f-8564-fb09ca5070ae","Type":"ContainerStarted","Data":"ce2b9877adb1817ebe852b2631b46ba202b94c84b22f73dcc22996b93e1b21b0"} Jul 29 15:02:11.191580 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.191555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:02:11.254417 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.254370 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-24rms" podStartSLOduration=3.551904335 podStartE2EDuration="27.254356584s" totalImagesPullingTime="23.702452249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:11.254022298 +0000 UTC m=+26.901105326" watchObservedRunningTime="2026-07-29 15:02:11.254356584 +0000 UTC m=+26.901439613" Jul 29 15:02:11.281132 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.281083 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" podStartSLOduration=6.757748986 podStartE2EDuration="26.281068007s" totalImagesPullingTime="19.523319021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:11.279968325 +0000 UTC m=+26.927051348" watchObservedRunningTime="2026-07-29 15:02:11.281068007 +0000 UTC m=+26.928151035" Jul 29 15:02:11.935873 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:11.935801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:11.936396 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:11.935928 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:12.180719 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.180685 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:02:12.180908 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.180776 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:02:12.195725 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.195643 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:02:12.721320 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.721066 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svmx6"] Jul 29 15:02:12.721543 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.721439 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:12.721634 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:12.721551 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:12.721834 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.721816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kxdmt"] Jul 29 15:02:12.721925 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.721913 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:12.722010 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:12.721991 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:12.723298 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.723275 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xd8zr"] Jul 29 15:02:12.723400 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:12.723358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:12.723463 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:12.723444 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:13.184426 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:13.184392 2578 generic.go:356] "Generic (PLEG): container finished" podID="95f314eb-905b-4b6f-807e-3146c973e992" containerID="fc67014968cdd6965e610fae2668159ffb1d108a3b2ad8c9ff94ce399203d411" exitCode=0 Jul 29 15:02:13.184973 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:13.184475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerDied","Data":"fc67014968cdd6965e610fae2668159ffb1d108a3b2ad8c9ff94ce399203d411"} Jul 29 15:02:13.935750 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:13.935679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:13.935906 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:13.935777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:13.935906 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:13.935826 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:13.935979 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:13.935910 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:14.189001 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:14.188936 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerStarted","Data":"aed90ed32b327729271d28fa70ec38bd6203d44d1e2228c7aff7b9858e9d8db9"} Jul 29 15:02:14.936366 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:14.936278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:14.936544 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:14.936394 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:15.193564 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:15.193463 2578 generic.go:356] "Generic (PLEG): container finished" podID="95f314eb-905b-4b6f-807e-3146c973e992" containerID="aed90ed32b327729271d28fa70ec38bd6203d44d1e2228c7aff7b9858e9d8db9" exitCode=0 Jul 29 15:02:15.193564 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:15.193510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerDied","Data":"aed90ed32b327729271d28fa70ec38bd6203d44d1e2228c7aff7b9858e9d8db9"} Jul 29 15:02:15.935919 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:15.935675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:15.936127 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:15.935675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:15.936127 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:15.936022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:15.936127 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:15.936102 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:16.939121 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:16.939093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:16.939487 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:16.939194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:17.493333 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:17.493293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:17.493526 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.493448 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:17.493526 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.493524 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret podName:3fec9098-a15b-4612-b7bf-c86bec53940e nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.493504314 +0000 UTC m=+65.140587336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret") pod "global-pull-secret-syncer-kxdmt" (UID: "3fec9098-a15b-4612-b7bf-c86bec53940e") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:17.594002 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:17.593958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:17.594183 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.594088 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:17.594183 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.594158 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs podName:cd920715-09e0-4206-aac2-0e412a5ec171 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.594138826 +0000 UTC m=+65.241221840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs") pod "network-metrics-daemon-xd8zr" (UID: "cd920715-09e0-4206-aac2-0e412a5ec171") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:17.695163 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:17.695128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:17.695336 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.695291 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:02:17.695336 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.695313 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:02:17.695336 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.695326 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xwjbl for pod openshift-network-diagnostics/network-check-target-svmx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:17.695457 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.695378 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl podName:a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.695364733 +0000 UTC m=+65.342447745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjbl" (UniqueName: "kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl") pod "network-check-target-svmx6" (UID: "a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:17.936017 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:17.935978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:17.936181 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:17.936020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:17.936181 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.936117 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svmx6" podUID="a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f" Jul 29 15:02:17.936309 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:17.936251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxdmt" podUID="3fec9098-a15b-4612-b7bf-c86bec53940e" Jul 29 15:02:18.936301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:18.936266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:18.936756 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:18.936390 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xd8zr" podUID="cd920715-09e0-4206-aac2-0e412a5ec171" Jul 29 15:02:19.203555 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.203469 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-24.ec2.internal" event="NodeReady" Jul 29 15:02:19.203735 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.203645 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:02:19.291651 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.291594 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4gsn6"] Jul 29 15:02:19.294162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.294137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.297891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.296386 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t7nmv"] Jul 29 15:02:19.299098 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.299073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:02:19.299219 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.299142 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:02:19.299219 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.299186 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kscqp\"" Jul 29 15:02:19.299351 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.299332 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:02:19.299406 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.299368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.302169 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.302123 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:02:19.302264 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.302246 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:02:19.302330 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.302317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzscc\"" Jul 29 15:02:19.315223 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.315096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4gsn6"] Jul 29 15:02:19.315901 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.315882 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t7nmv"] Jul 29 15:02:19.406953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.406926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4b5378-11da-46ea-87af-018478037927-config-volume\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.407073 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.406960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pss7r\" (UniqueName: \"kubernetes.io/projected/4a4b5378-11da-46ea-87af-018478037927-kube-api-access-pss7r\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.407073 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.406991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3418b8-919c-4c67-aa19-ccd3b1ff1062-cert\") pod \"ingress-canary-4gsn6\" (UID: \"7f3418b8-919c-4c67-aa19-ccd3b1ff1062\") " pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.407073 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.407006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.407181 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.407088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nck5\" (UniqueName: \"kubernetes.io/projected/7f3418b8-919c-4c67-aa19-ccd3b1ff1062-kube-api-access-5nck5\") pod \"ingress-canary-4gsn6\" (UID: \"7f3418b8-919c-4c67-aa19-ccd3b1ff1062\") " pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.407181 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.407119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4b5378-11da-46ea-87af-018478037927-tmp-dir\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.508207 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4b5378-11da-46ea-87af-018478037927-config-volume\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.508331 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pss7r\" (UniqueName: \"kubernetes.io/projected/4a4b5378-11da-46ea-87af-018478037927-kube-api-access-pss7r\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.508331 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3418b8-919c-4c67-aa19-ccd3b1ff1062-cert\") pod \"ingress-canary-4gsn6\" (UID: \"7f3418b8-919c-4c67-aa19-ccd3b1ff1062\") " pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.508331 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.508331 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nck5\" (UniqueName: \"kubernetes.io/projected/7f3418b8-919c-4c67-aa19-ccd3b1ff1062-kube-api-access-5nck5\") pod \"ingress-canary-4gsn6\" (UID: \"7f3418b8-919c-4c67-aa19-ccd3b1ff1062\") " pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.508331 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4b5378-11da-46ea-87af-018478037927-tmp-dir\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.508587 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:19.508408 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:19.508587 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:19.508493 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls podName:4a4b5378-11da-46ea-87af-018478037927 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:20.008470811 +0000 UTC m=+35.655553841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls") pod "dns-default-t7nmv" (UID: "4a4b5378-11da-46ea-87af-018478037927") : secret "dns-default-metrics-tls" not found Jul 29 15:02:19.508732 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.508703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4b5378-11da-46ea-87af-018478037927-tmp-dir\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.509078 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.509056 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4b5378-11da-46ea-87af-018478037927-config-volume\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.512934 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.512910 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3418b8-919c-4c67-aa19-ccd3b1ff1062-cert\") pod \"ingress-canary-4gsn6\" (UID: \"7f3418b8-919c-4c67-aa19-ccd3b1ff1062\") " pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.522243 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.522217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pss7r\" (UniqueName: \"kubernetes.io/projected/4a4b5378-11da-46ea-87af-018478037927-kube-api-access-pss7r\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:19.522325 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.522272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nck5\" (UniqueName: \"kubernetes.io/projected/7f3418b8-919c-4c67-aa19-ccd3b1ff1062-kube-api-access-5nck5\") pod \"ingress-canary-4gsn6\" (UID: \"7f3418b8-919c-4c67-aa19-ccd3b1ff1062\") " pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.609229 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.609193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4gsn6" Jul 29 15:02:19.738663 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.738634 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4gsn6"] Jul 29 15:02:19.743005 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:19.742976 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3418b8_919c_4c67_aa19_ccd3b1ff1062.slice/crio-7ef5f4c10142f6c692aa50c334768052eaaa380bdc880ad9550049bad3369c1b WatchSource:0}: Error finding container 7ef5f4c10142f6c692aa50c334768052eaaa380bdc880ad9550049bad3369c1b: Status 404 returned error can't find the container with id 7ef5f4c10142f6c692aa50c334768052eaaa380bdc880ad9550049bad3369c1b Jul 29 15:02:19.935743 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.935715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:19.935891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.935715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:19.938451 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.938431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ws96\"" Jul 29 15:02:19.939044 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.938431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:02:19.939044 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.938478 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:02:19.939044 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:19.938502 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:02:20.013915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.013726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:20.014109 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:20.013876 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:20.014109 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:20.014011 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls podName:4a4b5378-11da-46ea-87af-018478037927 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:21.013990316 +0000 UTC m=+36.661073322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls") pod "dns-default-t7nmv" (UID: "4a4b5378-11da-46ea-87af-018478037927") : secret "dns-default-metrics-tls" not found Jul 29 15:02:20.208918 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.208833 2578 generic.go:356] "Generic (PLEG): container finished" podID="95f314eb-905b-4b6f-807e-3146c973e992" containerID="a671a4e98f8b5806e60424fae75a58255f074d91fdaf59ad254bb22fdcb05ef5" exitCode=0 Jul 29 15:02:20.209066 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.208912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerDied","Data":"a671a4e98f8b5806e60424fae75a58255f074d91fdaf59ad254bb22fdcb05ef5"} Jul 29 15:02:20.209974 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.209955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4gsn6" event={"ID":"7f3418b8-919c-4c67-aa19-ccd3b1ff1062","Type":"ContainerStarted","Data":"7ef5f4c10142f6c692aa50c334768052eaaa380bdc880ad9550049bad3369c1b"} Jul 29 15:02:20.935985 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.935948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:20.938669 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.938641 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:02:20.938669 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:20.938650 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dwvq\"" Jul 29 15:02:21.021476 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.021447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:21.021657 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:21.021578 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:21.021720 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:21.021660 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls podName:4a4b5378-11da-46ea-87af-018478037927 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:23.021641401 +0000 UTC m=+38.668724414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls") pod "dns-default-t7nmv" (UID: "4a4b5378-11da-46ea-87af-018478037927") : secret "dns-default-metrics-tls" not found Jul 29 15:02:21.219527 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.219440 2578 generic.go:356] "Generic (PLEG): container finished" podID="95f314eb-905b-4b6f-807e-3146c973e992" containerID="e11d69b1114f7bf98e36e6497dae2f68303089afdb3ac9283279bbab9a9eb21e" exitCode=0 Jul 29 15:02:21.219527 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.219500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerDied","Data":"e11d69b1114f7bf98e36e6497dae2f68303089afdb3ac9283279bbab9a9eb21e"} Jul 29 15:02:21.329534 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.329502 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s"] Jul 29 15:02:21.331646 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.331623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" Jul 29 15:02:21.333784 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.333763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-94d72\"" Jul 29 15:02:21.343080 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.343031 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s"] Jul 29 15:02:21.425730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.425694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zqbv\" (UniqueName: \"kubernetes.io/projected/b864e6d2-8a80-4e05-a909-6a8ee943dad5-kube-api-access-9zqbv\") pod \"network-check-source-7d88cb55d8-6b68s\" (UID: \"b864e6d2-8a80-4e05-a909-6a8ee943dad5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" Jul 29 15:02:21.526974 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.526889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zqbv\" (UniqueName: \"kubernetes.io/projected/b864e6d2-8a80-4e05-a909-6a8ee943dad5-kube-api-access-9zqbv\") pod \"network-check-source-7d88cb55d8-6b68s\" (UID: \"b864e6d2-8a80-4e05-a909-6a8ee943dad5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" Jul 29 15:02:21.537442 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.537405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zqbv\" (UniqueName: \"kubernetes.io/projected/b864e6d2-8a80-4e05-a909-6a8ee943dad5-kube-api-access-9zqbv\") pod \"network-check-source-7d88cb55d8-6b68s\" (UID: \"b864e6d2-8a80-4e05-a909-6a8ee943dad5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" Jul 29 15:02:21.642539 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.642507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" Jul 29 15:02:21.789667 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:21.789562 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s"] Jul 29 15:02:21.794266 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:21.794234 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb864e6d2_8a80_4e05_a909_6a8ee943dad5.slice/crio-1e14d0414fafe7ee80ed0ed488187635a1014dd4399084de5aa461feba901c51 WatchSource:0}: Error finding container 1e14d0414fafe7ee80ed0ed488187635a1014dd4399084de5aa461feba901c51: Status 404 returned error can't find the container with id 1e14d0414fafe7ee80ed0ed488187635a1014dd4399084de5aa461feba901c51 Jul 29 15:02:22.226517 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:22.226273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8x22" event={"ID":"95f314eb-905b-4b6f-807e-3146c973e992","Type":"ContainerStarted","Data":"f76211ad08817538a4f67da755c278759fcd20bb4bec0eb1504c27eebcd2df0c"} Jul 29 15:02:22.227686 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:22.227659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" event={"ID":"b864e6d2-8a80-4e05-a909-6a8ee943dad5","Type":"ContainerStarted","Data":"1e14d0414fafe7ee80ed0ed488187635a1014dd4399084de5aa461feba901c51"} Jul 29 15:02:22.257263 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:22.257207 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p8x22" podStartSLOduration=7.258111664 podStartE2EDuration="37.257185509s" totalImagesPullingTime="29.999073845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:22.257113487 +0000 UTC m=+37.904196517" watchObservedRunningTime="2026-07-29 15:02:22.257185509 +0000 UTC m=+37.904268548" Jul 29 15:02:23.039798 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:23.039698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:23.039967 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:23.039919 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:23.040035 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:23.039989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls podName:4a4b5378-11da-46ea-87af-018478037927 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:27.039969825 +0000 UTC m=+42.687052854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls") pod "dns-default-t7nmv" (UID: "4a4b5378-11da-46ea-87af-018478037927") : secret "dns-default-metrics-tls" not found Jul 29 15:02:23.232247 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:23.232162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4gsn6" event={"ID":"7f3418b8-919c-4c67-aa19-ccd3b1ff1062","Type":"ContainerStarted","Data":"0f8c7f74d5f8daf5b597861a5f4d1753bee7e119a6c916c3faf4edf216881e3f"} Jul 29 15:02:23.255167 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:23.255109 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4gsn6" podStartSLOduration=1.117857888 podStartE2EDuration="4.255088252s" totalImagesPullingTime="3.137230364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:23.25426929 +0000 UTC m=+38.901352319" watchObservedRunningTime="2026-07-29 15:02:23.255088252 +0000 UTC m=+38.902171281" Jul 29 15:02:24.465581 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.465544 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v8wbs"] Jul 29 15:02:24.494729 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.494687 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8wbs"] Jul 29 15:02:24.494885 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.494819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.497385 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.497362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:02:24.497515 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.497441 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:02:24.498145 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.498113 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k86cr\"" Jul 29 15:02:24.498242 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.498167 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:02:24.498242 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.498176 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:02:24.651394 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.651359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.651563 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.651437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/faa9b566-9bcb-4897-9692-bf65abf341cb-crio-socket\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.651563 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.651465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8jsn\" (UniqueName: \"kubernetes.io/projected/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-api-access-p8jsn\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.651563 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.651534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa9b566-9bcb-4897-9692-bf65abf341cb-data-volume\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.651563 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.651556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752255 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/faa9b566-9bcb-4897-9692-bf65abf341cb-crio-socket\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752255 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8jsn\" (UniqueName: \"kubernetes.io/projected/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-api-access-p8jsn\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752471 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa9b566-9bcb-4897-9692-bf65abf341cb-data-volume\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752471 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752471 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752471 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:24.752418 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:24.752471 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:24.752447 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:24.752714 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/faa9b566-9bcb-4897-9692-bf65abf341cb-crio-socket\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.752714 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:24.752505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:25.252482317 +0000 UTC m=+40.899565346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:24.752714 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:24.752528 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:25.252517781 +0000 UTC m=+40.899600802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:24.752714 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.752668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa9b566-9bcb-4897-9692-bf65abf341cb-data-volume\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:24.763485 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:24.763459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8jsn\" (UniqueName: \"kubernetes.io/projected/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-api-access-p8jsn\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:25.255762 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.255732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:25.255916 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.255774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:25.255916 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:25.255859 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:25.256003 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:25.255924 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.255906546 +0000 UTC m=+41.902989553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:25.256003 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:25.255955 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:25.256069 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:25.256017 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.256003881 +0000 UTC m=+41.903086891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:25.760990 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.760955 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk"] Jul 29 15:02:25.782833 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.782803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk"] Jul 29 15:02:25.782982 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.782898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" Jul 29 15:02:25.785776 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.785749 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 15:02:25.786335 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.786314 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 15:02:25.786421 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.786382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bjzq8\"" Jul 29 15:02:25.960454 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:25.960353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x26p\" (UniqueName: \"kubernetes.io/projected/13420494-d7f6-447b-97ac-1228d57956ae-kube-api-access-8x26p\") pod \"migrator-6865c9967-jqxdk\" (UID: \"13420494-d7f6-447b-97ac-1228d57956ae\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" Jul 29 15:02:26.061812 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.061766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x26p\" (UniqueName: \"kubernetes.io/projected/13420494-d7f6-447b-97ac-1228d57956ae-kube-api-access-8x26p\") pod \"migrator-6865c9967-jqxdk\" (UID: \"13420494-d7f6-447b-97ac-1228d57956ae\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" Jul 29 15:02:26.070146 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.070113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x26p\" (UniqueName: \"kubernetes.io/projected/13420494-d7f6-447b-97ac-1228d57956ae-kube-api-access-8x26p\") pod \"migrator-6865c9967-jqxdk\" (UID: \"13420494-d7f6-447b-97ac-1228d57956ae\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" Jul 29 15:02:26.091920 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.091888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" Jul 29 15:02:26.241110 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.241030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" event={"ID":"b864e6d2-8a80-4e05-a909-6a8ee943dad5","Type":"ContainerStarted","Data":"d2986b259591a3b04670e3e705f733ce555343113693138565f166f188939baf"} Jul 29 15:02:26.256163 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.256114 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b68s" podStartSLOduration=1.410139067 podStartE2EDuration="5.25609994s" totalImagesPullingTime="3.845960873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:26.255570166 +0000 UTC m=+41.902653196" watchObservedRunningTime="2026-07-29 15:02:26.25609994 +0000 UTC m=+41.903182947" Jul 29 15:02:26.260286 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.260257 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk"] Jul 29 15:02:26.263487 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.263463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:26.263599 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:26.263489 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13420494_d7f6_447b_97ac_1228d57956ae.slice/crio-9e9cbd3efa40166896a5c26abff9fdddacaa41cfee53e858ad15b59b30439722 WatchSource:0}: Error finding container 9e9cbd3efa40166896a5c26abff9fdddacaa41cfee53e858ad15b59b30439722: Status 404 returned error can't find the container with id 9e9cbd3efa40166896a5c26abff9fdddacaa41cfee53e858ad15b59b30439722 Jul 29 15:02:26.263599 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.263511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:26.263599 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:26.263562 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:26.263767 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:26.263642 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:28.263623009 +0000 UTC m=+43.910706023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:26.263767 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:26.263691 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:26.263767 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:26.263748 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:28.26372964 +0000 UTC m=+43.910812675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:26.352256 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.352225 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn"] Jul 29 15:02:26.376807 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.376781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn"] Jul 29 15:02:26.376964 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.376874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:26.379063 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.379037 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 15:02:26.379186 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.379097 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 15:02:26.379335 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.379317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xsxtr\"" Jul 29 15:02:26.419891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.419868 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sq7gn_2af26be2-1734-4613-b5e9-a0252bc4bdac/dns-node-resolver/0.log" Jul 29 15:02:26.565892 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.565805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/486eb785-9dac-4934-bc42-4771936cb9dd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:26.566045 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.565950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:26.666496 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.666458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:26.666710 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.666527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/486eb785-9dac-4934-bc42-4771936cb9dd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:26.666710 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:26.666652 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 15:02:26.666838 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:26.666732 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert podName:486eb785-9dac-4934-bc42-4771936cb9dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:27.166710185 +0000 UTC m=+42.813793197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rmvmn" (UID: "486eb785-9dac-4934-bc42-4771936cb9dd") : secret "networking-console-plugin-cert" not found Jul 29 15:02:26.667403 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:26.667376 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/486eb785-9dac-4934-bc42-4771936cb9dd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:27.032775 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.032728 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-tplmd"] Jul 29 15:02:27.047463 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.047410 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-tplmd"] Jul 29 15:02:27.047663 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.047552 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.050263 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.050215 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 15:02:27.051445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.051000 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d8pcb\"" Jul 29 15:02:27.051445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.051017 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 15:02:27.051445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.051215 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 15:02:27.051445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.051285 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 15:02:27.069104 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.069065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92497c63-2516-4526-85d7-22264d4b5bbe-signing-key\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.069215 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.069105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwplx\" (UniqueName: \"kubernetes.io/projected/92497c63-2516-4526-85d7-22264d4b5bbe-kube-api-access-qwplx\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.069306 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.069286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92497c63-2516-4526-85d7-22264d4b5bbe-signing-cabundle\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.069366 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.069345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:27.069478 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:27.069460 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:27.069536 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:27.069528 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls podName:4a4b5378-11da-46ea-87af-018478037927 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:35.069509438 +0000 UTC m=+50.716592457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls") pod "dns-default-t7nmv" (UID: "4a4b5378-11da-46ea-87af-018478037927") : secret "dns-default-metrics-tls" not found Jul 29 15:02:27.170238 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.170182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:27.170238 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.170236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92497c63-2516-4526-85d7-22264d4b5bbe-signing-cabundle\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.170454 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.170344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92497c63-2516-4526-85d7-22264d4b5bbe-signing-key\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.170454 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:27.170351 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 15:02:27.170454 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.170374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwplx\" (UniqueName: \"kubernetes.io/projected/92497c63-2516-4526-85d7-22264d4b5bbe-kube-api-access-qwplx\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.170454 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:27.170427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert podName:486eb785-9dac-4934-bc42-4771936cb9dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:28.170405964 +0000 UTC m=+43.817488975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rmvmn" (UID: "486eb785-9dac-4934-bc42-4771936cb9dd") : secret "networking-console-plugin-cert" not found Jul 29 15:02:27.171552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.171381 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92497c63-2516-4526-85d7-22264d4b5bbe-signing-cabundle\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.175271 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.175240 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92497c63-2516-4526-85d7-22264d4b5bbe-signing-key\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.181160 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.181134 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwplx\" (UniqueName: \"kubernetes.io/projected/92497c63-2516-4526-85d7-22264d4b5bbe-kube-api-access-qwplx\") pod \"service-ca-658d7b7c78-tplmd\" (UID: \"92497c63-2516-4526-85d7-22264d4b5bbe\") " pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.219496 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.219469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5f5jh_270e426a-fe2a-414a-8d2b-e2db7bc7f0ec/node-ca/0.log" Jul 29 15:02:27.244468 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.244439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" event={"ID":"13420494-d7f6-447b-97ac-1228d57956ae","Type":"ContainerStarted","Data":"9e9cbd3efa40166896a5c26abff9fdddacaa41cfee53e858ad15b59b30439722"} Jul 29 15:02:27.359835 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.359804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" Jul 29 15:02:27.499309 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:27.499273 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-tplmd"] Jul 29 15:02:27.635160 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:27.635079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92497c63_2516_4526_85d7_22264d4b5bbe.slice/crio-bab11f410c01b10b3618913f5102f34b7406ecf4229079aa9ce88d5cfe120961 WatchSource:0}: Error finding container bab11f410c01b10b3618913f5102f34b7406ecf4229079aa9ce88d5cfe120961: Status 404 returned error can't find the container with id bab11f410c01b10b3618913f5102f34b7406ecf4229079aa9ce88d5cfe120961 Jul 29 15:02:28.019596 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.019568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4gsn6_7f3418b8-919c-4c67-aa19-ccd3b1ff1062/serve-healthcheck-canary/0.log" Jul 29 15:02:28.179336 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.179247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:28.179690 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:28.179401 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 15:02:28.179690 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:28.179470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert podName:486eb785-9dac-4934-bc42-4771936cb9dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:30.179454925 +0000 UTC m=+45.826537938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rmvmn" (UID: "486eb785-9dac-4934-bc42-4771936cb9dd") : secret "networking-console-plugin-cert" not found Jul 29 15:02:28.247593 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.247558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" event={"ID":"92497c63-2516-4526-85d7-22264d4b5bbe","Type":"ContainerStarted","Data":"bab11f410c01b10b3618913f5102f34b7406ecf4229079aa9ce88d5cfe120961"} Jul 29 15:02:28.249232 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.249202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" event={"ID":"13420494-d7f6-447b-97ac-1228d57956ae","Type":"ContainerStarted","Data":"6078c67bb3dd5c3f92c7bc457906e6e1a77fe7a5a897a1ace783d62aca983d38"} Jul 29 15:02:28.249343 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.249251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" event={"ID":"13420494-d7f6-447b-97ac-1228d57956ae","Type":"ContainerStarted","Data":"ad42e61e7b907d3e8810bc5365a1a5875be9852b977276b136dcf714e26888f1"} Jul 29 15:02:28.270432 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.270384 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jqxdk" podStartSLOduration=1.868435391 podStartE2EDuration="3.270366856s" totalImagesPullingTime="1.401931465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:28.269854662 +0000 UTC m=+43.916937693" watchObservedRunningTime="2026-07-29 15:02:28.270366856 +0000 UTC m=+43.917449889" Jul 29 15:02:28.280194 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.280167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:28.280299 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:28.280205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:28.280340 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:28.280308 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:28.280373 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:28.280341 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:28.280405 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:28.280377 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:32.280359654 +0000 UTC m=+47.927442678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:28.280405 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:28.280392 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:32.280386462 +0000 UTC m=+47.927469470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:30.193564 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:30.193537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:30.193913 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:30.193660 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 15:02:30.193913 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:30.193715 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert podName:486eb785-9dac-4934-bc42-4771936cb9dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:34.193701216 +0000 UTC m=+49.840784226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rmvmn" (UID: "486eb785-9dac-4934-bc42-4771936cb9dd") : secret "networking-console-plugin-cert" not found Jul 29 15:02:30.258230 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:30.258196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" event={"ID":"92497c63-2516-4526-85d7-22264d4b5bbe","Type":"ContainerStarted","Data":"ef1e99e6d62334c0eaf9984c1096b599790788afc1639ffa88cb2c5cb9ed9237"} Jul 29 15:02:30.275394 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:30.275342 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-tplmd" podStartSLOduration=0.853418427 podStartE2EDuration="3.275297767s" totalImagesPullingTime="2.42187934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:30.274052014 +0000 UTC m=+45.921135043" watchObservedRunningTime="2026-07-29 15:02:30.275297767 +0000 UTC m=+45.922380809" Jul 29 15:02:32.306574 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:32.306536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:32.306989 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:32.306601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:32.306989 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:32.306678 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:32.306989 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:32.306744 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:40.306728248 +0000 UTC m=+55.953811260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : configmap "kube-rbac-proxy" not found Jul 29 15:02:32.306989 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:32.306789 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:32.306989 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:32.306856 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:40.306838815 +0000 UTC m=+55.953921827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:34.221675 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:34.221624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:34.222088 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:34.221748 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 15:02:34.222088 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:34.221803 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert podName:486eb785-9dac-4934-bc42-4771936cb9dd nodeName:}" failed. No retries permitted until 2026-07-29 15:02:42.221788939 +0000 UTC m=+57.868871950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rmvmn" (UID: "486eb785-9dac-4934-bc42-4771936cb9dd") : secret "networking-console-plugin-cert" not found Jul 29 15:02:35.129078 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:35.129043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:35.129249 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:35.129189 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:35.129293 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:35.129256 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls podName:4a4b5378-11da-46ea-87af-018478037927 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:51.129240375 +0000 UTC m=+66.776323386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls") pod "dns-default-t7nmv" (UID: "4a4b5378-11da-46ea-87af-018478037927") : secret "dns-default-metrics-tls" not found Jul 29 15:02:40.367235 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:40.367199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:40.367865 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:40.367246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:40.367865 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:40.367359 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:40.367865 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:40.367420 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls podName:faa9b566-9bcb-4897-9692-bf65abf341cb nodeName:}" failed. No retries permitted until 2026-07-29 15:02:56.367406106 +0000 UTC m=+72.014489118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v8wbs" (UID: "faa9b566-9bcb-4897-9692-bf65abf341cb") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:40.367865 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:40.367710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/faa9b566-9bcb-4897-9692-bf65abf341cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:42.280546 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:42.280492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:42.282832 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:42.282812 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/486eb785-9dac-4934-bc42-4771936cb9dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rmvmn\" (UID: \"486eb785-9dac-4934-bc42-4771936cb9dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:42.286696 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:42.286678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" Jul 29 15:02:42.409654 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:42.409622 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn"] Jul 29 15:02:42.412735 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:42.412701 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486eb785_9dac_4934_bc42_4771936cb9dd.slice/crio-cb3acd0814ecb885f4029f38f09b6878100a747d7b1b64335a949920f8759756 WatchSource:0}: Error finding container cb3acd0814ecb885f4029f38f09b6878100a747d7b1b64335a949920f8759756: Status 404 returned error can't find the container with id cb3acd0814ecb885f4029f38f09b6878100a747d7b1b64335a949920f8759756 Jul 29 15:02:43.294620 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:43.294584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" event={"ID":"486eb785-9dac-4934-bc42-4771936cb9dd","Type":"ContainerStarted","Data":"cb3acd0814ecb885f4029f38f09b6878100a747d7b1b64335a949920f8759756"} Jul 29 15:02:44.199082 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:44.199056 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z84l6" Jul 29 15:02:44.299555 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:44.299519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" event={"ID":"486eb785-9dac-4934-bc42-4771936cb9dd","Type":"ContainerStarted","Data":"995c2bd94ef30a24f76a6e0fcbd6bca2cef198d6d7621f728dac59c664ecb49e"} Jul 29 15:02:44.317718 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:44.317638 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rmvmn" podStartSLOduration=17.146685428 podStartE2EDuration="18.317599452s" totalImagesPullingTime="1.170914024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:44.31629134 +0000 UTC m=+59.963374368" watchObservedRunningTime="2026-07-29 15:02:44.317599452 +0000 UTC m=+59.964682482" Jul 29 15:02:49.532798 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.532757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:49.535261 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.535242 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:02:49.545149 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.545125 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fec9098-a15b-4612-b7bf-c86bec53940e-original-pull-secret\") pod \"global-pull-secret-syncer-kxdmt\" (UID: \"3fec9098-a15b-4612-b7bf-c86bec53940e\") " pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:49.633545 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.633509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:49.635700 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.635668 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:02:49.646354 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.646330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd920715-09e0-4206-aac2-0e412a5ec171-metrics-certs\") pod \"network-metrics-daemon-xd8zr\" (UID: \"cd920715-09e0-4206-aac2-0e412a5ec171\") " pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:49.650208 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.650189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxdmt" Jul 29 15:02:49.734177 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.734147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:49.736672 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.736648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwjbl\" (UniqueName: \"kubernetes.io/projected/a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f-kube-api-access-xwjbl\") pod \"network-check-target-svmx6\" (UID: \"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f\") " pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:49.748464 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.748439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dwvq\"" Jul 29 15:02:49.757358 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.757330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xd8zr" Jul 29 15:02:49.786586 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.784992 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kxdmt"] Jul 29 15:02:49.788501 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:49.788476 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fec9098_a15b_4612_b7bf_c86bec53940e.slice/crio-8db6d3acb14fe86520e3328170d8ce6359da20dfb690d52ac9d8f4cb4c1c1fc7 WatchSource:0}: Error finding container 8db6d3acb14fe86520e3328170d8ce6359da20dfb690d52ac9d8f4cb4c1c1fc7: Status 404 returned error can't find the container with id 8db6d3acb14fe86520e3328170d8ce6359da20dfb690d52ac9d8f4cb4c1c1fc7 Jul 29 15:02:49.878240 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.878207 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xd8zr"] Jul 29 15:02:49.880931 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:49.880897 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd920715_09e0_4206_aac2_0e412a5ec171.slice/crio-2bdaa85661c6f7b57e8087f9b816b6a01754c2a3fe4dd3e839d0e93b69e67b80 WatchSource:0}: Error finding container 2bdaa85661c6f7b57e8087f9b816b6a01754c2a3fe4dd3e839d0e93b69e67b80: Status 404 returned error can't find the container with id 2bdaa85661c6f7b57e8087f9b816b6a01754c2a3fe4dd3e839d0e93b69e67b80 Jul 29 15:02:49.948237 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.948209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ws96\"" Jul 29 15:02:49.956181 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:49.956166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:50.077600 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.077530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svmx6"] Jul 29 15:02:50.080327 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:50.080296 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f9e0c6_8eae_4c1e_81e2_2f3acfa8df6f.slice/crio-14ba02433305f9263bf23b80fce9822017db3134fab9f7eaf6c7cf9b91d8551d WatchSource:0}: Error finding container 14ba02433305f9263bf23b80fce9822017db3134fab9f7eaf6c7cf9b91d8551d: Status 404 returned error can't find the container with id 14ba02433305f9263bf23b80fce9822017db3134fab9f7eaf6c7cf9b91d8551d Jul 29 15:02:50.318264 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.318220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svmx6" event={"ID":"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f","Type":"ContainerStarted","Data":"04091591bea955b07b91f05fd96bad9b26dd350770d759dce8349f5ec743fedf"} Jul 29 15:02:50.318462 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.318291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svmx6" event={"ID":"a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f","Type":"ContainerStarted","Data":"14ba02433305f9263bf23b80fce9822017db3134fab9f7eaf6c7cf9b91d8551d"} Jul 29 15:02:50.318462 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.318389 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:02:50.319496 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.319473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xd8zr" event={"ID":"cd920715-09e0-4206-aac2-0e412a5ec171","Type":"ContainerStarted","Data":"2bdaa85661c6f7b57e8087f9b816b6a01754c2a3fe4dd3e839d0e93b69e67b80"} Jul 29 15:02:50.320742 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.320719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kxdmt" event={"ID":"3fec9098-a15b-4612-b7bf-c86bec53940e","Type":"ContainerStarted","Data":"8db6d3acb14fe86520e3328170d8ce6359da20dfb690d52ac9d8f4cb4c1c1fc7"} Jul 29 15:02:50.346050 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:50.346000 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-svmx6" podStartSLOduration=65.345981275 podStartE2EDuration="1m5.345981275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:50.344817688 +0000 UTC m=+65.991900730" watchObservedRunningTime="2026-07-29 15:02:50.345981275 +0000 UTC m=+65.993064328" Jul 29 15:02:51.145876 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:51.145836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:51.148850 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:51.148823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4b5378-11da-46ea-87af-018478037927-metrics-tls\") pod \"dns-default-t7nmv\" (UID: \"4a4b5378-11da-46ea-87af-018478037927\") " pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:51.418010 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:51.417942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzscc\"" Jul 29 15:02:51.426178 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:51.426149 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:51.635234 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:51.635209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t7nmv"] Jul 29 15:02:52.321993 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.321955 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v"] Jul 29 15:02:52.341168 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.341093 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xd8zr" event={"ID":"cd920715-09e0-4206-aac2-0e412a5ec171","Type":"ContainerStarted","Data":"a705f0d977b5fbaa6b5f6009ee544293ce3c66e7f15eefd17a406c5da42f2a80"} Jul 29 15:02:52.341168 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.341147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v"] Jul 29 15:02:52.341168 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.341174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xd8zr" event={"ID":"cd920715-09e0-4206-aac2-0e412a5ec171","Type":"ContainerStarted","Data":"3f6211edb0a9e015370e52cc231850e03004c8d200a5346e0e0c1163c9045a46"} Jul 29 15:02:52.341445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.341196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t7nmv" event={"ID":"4a4b5378-11da-46ea-87af-018478037927","Type":"ContainerStarted","Data":"cdcbfd2c131ac9b5dd57d5230f8f00dea42b4cbc55d81bdcedd992cc2b48cb7c"} Jul 29 15:02:52.341445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.341288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:52.345197 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.345172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4zzjs\"" Jul 29 15:02:52.346735 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.346712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 15:02:52.373916 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.373860 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xd8zr" podStartSLOduration=65.810416033 podStartE2EDuration="1m7.373842044s" totalImagesPullingTime="1.563426011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:52.358140881 +0000 UTC m=+68.005223915" watchObservedRunningTime="2026-07-29 15:02:52.373842044 +0000 UTC m=+68.020925073" Jul 29 15:02:52.457233 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.457193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b158cc-c858-496b-bd88-058edd7c1982-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bzg4v\" (UID: \"51b158cc-c858-496b-bd88-058edd7c1982\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:52.558055 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:52.558019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b158cc-c858-496b-bd88-058edd7c1982-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bzg4v\" (UID: \"51b158cc-c858-496b-bd88-058edd7c1982\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:52.558225 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:52.558134 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 29 15:02:52.558225 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:02:52.558203 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b158cc-c858-496b-bd88-058edd7c1982-tls-certificates podName:51b158cc-c858-496b-bd88-058edd7c1982 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:53.058182141 +0000 UTC m=+68.705265152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/51b158cc-c858-496b-bd88-058edd7c1982-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" (UID: "51b158cc-c858-496b-bd88-058edd7c1982") : secret "prometheus-operator-admission-webhook-tls" not found Jul 29 15:02:53.061416 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:53.061375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b158cc-c858-496b-bd88-058edd7c1982-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bzg4v\" (UID: \"51b158cc-c858-496b-bd88-058edd7c1982\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:53.064090 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:53.064061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b158cc-c858-496b-bd88-058edd7c1982-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bzg4v\" (UID: \"51b158cc-c858-496b-bd88-058edd7c1982\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:53.252260 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:53.252224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:53.610628 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:53.610580 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v"] Jul 29 15:02:53.613783 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:53.613750 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b158cc_c858_496b_bd88_058edd7c1982.slice/crio-cd7ccbe969a08c5835b5945229e3952d182cadc3f5b54a95fccd4e4843c7d290 WatchSource:0}: Error finding container cd7ccbe969a08c5835b5945229e3952d182cadc3f5b54a95fccd4e4843c7d290: Status 404 returned error can't find the container with id cd7ccbe969a08c5835b5945229e3952d182cadc3f5b54a95fccd4e4843c7d290 Jul 29 15:02:54.343170 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:54.343129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kxdmt" event={"ID":"3fec9098-a15b-4612-b7bf-c86bec53940e","Type":"ContainerStarted","Data":"6bd3999bfa00faef1f8db92120ec3d5b3b9e03c70dc672d4d5ee967da7fb0b7b"} Jul 29 15:02:54.344864 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:54.344829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" event={"ID":"51b158cc-c858-496b-bd88-058edd7c1982","Type":"ContainerStarted","Data":"cd7ccbe969a08c5835b5945229e3952d182cadc3f5b54a95fccd4e4843c7d290"} Jul 29 15:02:54.363956 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:54.363897 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kxdmt" podStartSLOduration=65.322918682 podStartE2EDuration="1m9.363874582s" totalImagesPullingTime="4.0409559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:54.361551302 +0000 UTC m=+70.008634334" watchObservedRunningTime="2026-07-29 15:02:54.363874582 +0000 UTC m=+70.010957608" Jul 29 15:02:55.349686 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:55.349646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t7nmv" event={"ID":"4a4b5378-11da-46ea-87af-018478037927","Type":"ContainerStarted","Data":"1104b40677dd2e41bdc24de3be8bbd209c117ec77776d99093b78adc135cf5c5"} Jul 29 15:02:55.350151 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:55.349711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t7nmv" event={"ID":"4a4b5378-11da-46ea-87af-018478037927","Type":"ContainerStarted","Data":"cf5dee2848e6aabcf56d80ccf9b9a8508f29d40f71ae8028c4b185f2c50e64b2"} Jul 29 15:02:55.350151 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:55.349786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t7nmv" Jul 29 15:02:55.351071 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:55.351048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" event={"ID":"51b158cc-c858-496b-bd88-058edd7c1982","Type":"ContainerStarted","Data":"2179b845b282781956f75aef8b654394da3b252641b174e422561f2935ba4eec"} Jul 29 15:02:55.392891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:55.392805 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t7nmv" podStartSLOduration=32.899490939 podStartE2EDuration="36.392789975s" totalImagesPullingTime="3.493299036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:55.391020565 +0000 UTC m=+71.038103596" watchObservedRunningTime="2026-07-29 15:02:55.392789975 +0000 UTC m=+71.039873003" Jul 29 15:02:55.419385 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:55.419335 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" podStartSLOduration=1.912247533 podStartE2EDuration="3.419317744s" totalImagesPullingTime="1.507070211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:55.419218425 +0000 UTC m=+71.066301456" watchObservedRunningTime="2026-07-29 15:02:55.419317744 +0000 UTC m=+71.066400774" Jul 29 15:02:56.354739 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.354707 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:56.359319 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.359299 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bzg4v" Jul 29 15:02:56.385547 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.385512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:56.387987 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.387955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/faa9b566-9bcb-4897-9692-bf65abf341cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8wbs\" (UID: \"faa9b566-9bcb-4897-9692-bf65abf341cb\") " pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:56.609867 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.609785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k86cr\"" Jul 29 15:02:56.616926 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.616902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8wbs" Jul 29 15:02:56.767623 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:56.767003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8wbs"] Jul 29 15:02:56.769596 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:56.769558 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa9b566_9bcb_4897_9692_bf65abf341cb.slice/crio-07d6189e6d595ffab20273b946fbce9b4d9dbfe21c7b03cecb05fc8fb3b7c768 WatchSource:0}: Error finding container 07d6189e6d595ffab20273b946fbce9b4d9dbfe21c7b03cecb05fc8fb3b7c768: Status 404 returned error can't find the container with id 07d6189e6d595ffab20273b946fbce9b4d9dbfe21c7b03cecb05fc8fb3b7c768 Jul 29 15:02:57.358725 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.358683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8wbs" event={"ID":"faa9b566-9bcb-4897-9692-bf65abf341cb","Type":"ContainerStarted","Data":"07d6189e6d595ffab20273b946fbce9b4d9dbfe21c7b03cecb05fc8fb3b7c768"} Jul 29 15:02:57.417770 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.417740 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wkltg"] Jul 29 15:02:57.420574 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.420558 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.423694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.423673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 15:02:57.423788 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.423679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 15:02:57.424392 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.424376 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pfl8k\"" Jul 29 15:02:57.424751 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.424727 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:02:57.424751 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.424742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:02:57.424915 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.424733 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:02:57.433092 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.433072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wkltg"] Jul 29 15:02:57.492672 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.492644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lwr\" (UniqueName: \"kubernetes.io/projected/e1db0bad-c2e6-4c5a-b44b-901839b22d54-kube-api-access-72lwr\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.492813 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.492693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1db0bad-c2e6-4c5a-b44b-901839b22d54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.492813 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.492752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1db0bad-c2e6-4c5a-b44b-901839b22d54-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.492813 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.492783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1db0bad-c2e6-4c5a-b44b-901839b22d54-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.593482 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.593437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1db0bad-c2e6-4c5a-b44b-901839b22d54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.593482 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.593491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1db0bad-c2e6-4c5a-b44b-901839b22d54-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.593769 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.593509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1db0bad-c2e6-4c5a-b44b-901839b22d54-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.593769 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.593534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lwr\" (UniqueName: \"kubernetes.io/projected/e1db0bad-c2e6-4c5a-b44b-901839b22d54-kube-api-access-72lwr\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.594292 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.594266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1db0bad-c2e6-4c5a-b44b-901839b22d54-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.595862 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.595842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1db0bad-c2e6-4c5a-b44b-901839b22d54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.596073 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.596007 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1db0bad-c2e6-4c5a-b44b-901839b22d54-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.607590 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.607565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lwr\" (UniqueName: \"kubernetes.io/projected/e1db0bad-c2e6-4c5a-b44b-901839b22d54-kube-api-access-72lwr\") pod \"prometheus-operator-84d69f794d-wkltg\" (UID: \"e1db0bad-c2e6-4c5a-b44b-901839b22d54\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.729488 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.729398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" Jul 29 15:02:57.873306 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:57.873225 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wkltg"] Jul 29 15:02:57.875651 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:02:57.875605 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1db0bad_c2e6_4c5a_b44b_901839b22d54.slice/crio-c86f5c3fbaf0e61029318403588364b8b629f709beeb1e4d70b3e27a2caf6058 WatchSource:0}: Error finding container c86f5c3fbaf0e61029318403588364b8b629f709beeb1e4d70b3e27a2caf6058: Status 404 returned error can't find the container with id c86f5c3fbaf0e61029318403588364b8b629f709beeb1e4d70b3e27a2caf6058 Jul 29 15:02:58.365123 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:58.365039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" event={"ID":"e1db0bad-c2e6-4c5a-b44b-901839b22d54","Type":"ContainerStarted","Data":"c86f5c3fbaf0e61029318403588364b8b629f709beeb1e4d70b3e27a2caf6058"} Jul 29 15:02:59.370239 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:59.370160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" event={"ID":"e1db0bad-c2e6-4c5a-b44b-901839b22d54","Type":"ContainerStarted","Data":"0a8d08eea9834eac358a90fb6aa7f325b5deae185a511df63e8f63bcf6dd5f7d"} Jul 29 15:02:59.370239 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:59.370210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" event={"ID":"e1db0bad-c2e6-4c5a-b44b-901839b22d54","Type":"ContainerStarted","Data":"5de3c21a45b3bfefc8b7ffa71bfa4ade92611e34affba66d5409328f713ad979"} Jul 29 15:02:59.397643 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:02:59.397578 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-wkltg" podStartSLOduration=1.1686308 podStartE2EDuration="2.397562274s" totalImagesPullingTime="1.228931474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:59.396253925 +0000 UTC m=+75.043336954" watchObservedRunningTime="2026-07-29 15:02:59.397562274 +0000 UTC m=+75.044645302" Jul 29 15:03:02.194794 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.194756 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mcc79"] Jul 29 15:03:02.207191 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.207162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.215748 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.215722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:03:02.216022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.216004 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-68ttx\"" Jul 29 15:03:02.216960 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.216867 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:03:02.217763 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.217743 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:03:02.332184 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-tls\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332372 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faf34d6a-77d8-4da9-bfb9-8f30435062c8-metrics-client-ca\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332372 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332497 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-wtmp\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332497 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-root\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332497 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-sys\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332675 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332675 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4lv7\" (UniqueName: \"kubernetes.io/projected/faf34d6a-77d8-4da9-bfb9-8f30435062c8-kube-api-access-t4lv7\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.332675 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.332589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-textfile\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433302 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-wtmp\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433302 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-root\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-sys\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4lv7\" (UniqueName: \"kubernetes.io/projected/faf34d6a-77d8-4da9-bfb9-8f30435062c8-kube-api-access-t4lv7\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-textfile\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-tls\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433461 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-root\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433463 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-sys\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faf34d6a-77d8-4da9-bfb9-8f30435062c8-metrics-client-ca\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.433552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433462 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-wtmp\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.434076 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.433564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.434135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.434125 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faf34d6a-77d8-4da9-bfb9-8f30435062c8-metrics-client-ca\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.434633 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.434363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-textfile\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.434756 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.434731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.436432 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.436406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-tls\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.436432 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.436426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/faf34d6a-77d8-4da9-bfb9-8f30435062c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.445827 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.445751 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4lv7\" (UniqueName: \"kubernetes.io/projected/faf34d6a-77d8-4da9-bfb9-8f30435062c8-kube-api-access-t4lv7\") pod \"node-exporter-mcc79\" (UID: \"faf34d6a-77d8-4da9-bfb9-8f30435062c8\") " pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:02.517831 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:02.517796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcc79" Jul 29 15:03:04.055848 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:03:04.055815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf34d6a_77d8_4da9_bfb9_8f30435062c8.slice/crio-2415a054c6567fa8ee53711695cf5fbb82e04e9986f07761e6d599f2759263f2 WatchSource:0}: Error finding container 2415a054c6567fa8ee53711695cf5fbb82e04e9986f07761e6d599f2759263f2: Status 404 returned error can't find the container with id 2415a054c6567fa8ee53711695cf5fbb82e04e9986f07761e6d599f2759263f2 Jul 29 15:03:04.391591 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:04.391554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8wbs" event={"ID":"faa9b566-9bcb-4897-9692-bf65abf341cb","Type":"ContainerStarted","Data":"e30347fc2ac5652cec5d16378f3ded340a0e95a385fe6f9d31b4461f1e4acf34"} Jul 29 15:03:04.392795 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:04.392771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcc79" event={"ID":"faf34d6a-77d8-4da9-bfb9-8f30435062c8","Type":"ContainerStarted","Data":"2415a054c6567fa8ee53711695cf5fbb82e04e9986f07761e6d599f2759263f2"} Jul 29 15:03:05.356879 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:05.356838 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t7nmv" Jul 29 15:03:05.400995 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:05.400908 2578 generic.go:356] "Generic (PLEG): container finished" podID="faf34d6a-77d8-4da9-bfb9-8f30435062c8" containerID="2f381c5b86749b7057cc2950d8f386acd4c6080bf77132671da8bb8753971bb8" exitCode=0 Jul 29 15:03:05.401153 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:05.401024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcc79" event={"ID":"faf34d6a-77d8-4da9-bfb9-8f30435062c8","Type":"ContainerDied","Data":"2f381c5b86749b7057cc2950d8f386acd4c6080bf77132671da8bb8753971bb8"} Jul 29 15:03:06.149322 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.149208 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58cd58788b-796qd"] Jul 29 15:03:06.157478 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.157458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.160184 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160108 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d9n8nqfo3eq9b\"" Jul 29 15:03:06.160184 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160109 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 15:03:06.160184 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160170 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 15:03:06.160415 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160112 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mp5gg\"" Jul 29 15:03:06.160855 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 15:03:06.160994 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160831 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 15:03:06.160994 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.160837 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 15:03:06.166230 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.166061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58cd58788b-796qd"] Jul 29 15:03:06.265258 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265436 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/170fe77b-1691-40b0-b418-0a96edbe7137-metrics-client-ca\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265436 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265436 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-tls\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265627 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265627 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265627 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-grpc-tls\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.265627 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.265589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmsj\" (UniqueName: \"kubernetes.io/projected/170fe77b-1691-40b0-b418-0a96edbe7137-kube-api-access-jqmsj\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.366730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-grpc-tls\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmsj\" (UniqueName: \"kubernetes.io/projected/170fe77b-1691-40b0-b418-0a96edbe7137-kube-api-access-jqmsj\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/170fe77b-1691-40b0-b418-0a96edbe7137-metrics-client-ca\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-tls\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.366958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.367882 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.367842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/170fe77b-1691-40b0-b418-0a96edbe7137-metrics-client-ca\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.369930 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.369851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.370038 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.369955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.370038 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.370021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-grpc-tls\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.370158 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.370047 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.370354 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.370332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.370968 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.370947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/170fe77b-1691-40b0-b418-0a96edbe7137-secret-thanos-querier-tls\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.377094 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.377066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmsj\" (UniqueName: \"kubernetes.io/projected/170fe77b-1691-40b0-b418-0a96edbe7137-kube-api-access-jqmsj\") pod \"thanos-querier-58cd58788b-796qd\" (UID: \"170fe77b-1691-40b0-b418-0a96edbe7137\") " pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.408163 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.408092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcc79" event={"ID":"faf34d6a-77d8-4da9-bfb9-8f30435062c8","Type":"ContainerStarted","Data":"74d50d2c3829a3063416a2ca177a9d88bfc751f08faf9a736293ffebd453e37a"} Jul 29 15:03:06.408163 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.408161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcc79" event={"ID":"faf34d6a-77d8-4da9-bfb9-8f30435062c8","Type":"ContainerStarted","Data":"6cb2cd889f34cecb9e3846b2455d9d5baaac347fe8c79dc2e1076f2353cd79f1"} Jul 29 15:03:06.468736 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.468702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:06.497792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:06.497740 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mcc79" podStartSLOduration=3.348447825 podStartE2EDuration="4.497722607s" totalImagesPullingTime="1.064847309s" totalInitContainerRuntime="84.427473ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:06.496688956 +0000 UTC m=+82.143771999" watchObservedRunningTime="2026-07-29 15:03:06.497722607 +0000 UTC m=+82.144805637" Jul 29 15:03:07.918122 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:07.918086 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58cd58788b-796qd"] Jul 29 15:03:07.923268 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:03:07.923242 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170fe77b_1691_40b0_b418_0a96edbe7137.slice/crio-5e38839f92c600e7ab7b30cfe4a4fae5794688ed6bdaf785e835211d021e7582 WatchSource:0}: Error finding container 5e38839f92c600e7ab7b30cfe4a4fae5794688ed6bdaf785e835211d021e7582: Status 404 returned error can't find the container with id 5e38839f92c600e7ab7b30cfe4a4fae5794688ed6bdaf785e835211d021e7582 Jul 29 15:03:08.417319 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.417282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"5e38839f92c600e7ab7b30cfe4a4fae5794688ed6bdaf785e835211d021e7582"} Jul 29 15:03:08.418948 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.418925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8wbs" event={"ID":"faa9b566-9bcb-4897-9692-bf65abf341cb","Type":"ContainerStarted","Data":"87e7bb8278f2717a07071da634a5c9e20a974a1fc374132de2d531009f4f5db2"} Jul 29 15:03:08.666116 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.666079 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:03:08.671665 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.671584 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.688396 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.688369 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 15:03:08.688675 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.688657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 15:03:08.689078 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.688923 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 15:03:08.689078 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.689058 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 15:03:08.689346 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.689326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 15:03:08.690019 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.689995 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:03:08.690219 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690205 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 15:03:08.690898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k99mn\"" Jul 29 15:03:08.690898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 15:03:08.690898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690552 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 15:03:08.690898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690485 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bke94o9ce4bt2\"" Jul 29 15:03:08.690898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690711 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 15:03:08.690898 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.690809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 15:03:08.693178 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.693001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 15:03:08.699172 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.698968 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 15:03:08.706723 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.703913 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:03:08.706723 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.706291 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 15:03:08.719686 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.719657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 15:03:08.786718 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-config\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.786900 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.786953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cqcf\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-kube-api-access-2cqcf\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787824 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.787824 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.787402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.890836 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-config\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.890982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891022 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cqcf\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-kube-api-access-2cqcf\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.891380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.891355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.894707 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.894099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.894707 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.894324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.896751 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.894827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.896751 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.895604 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.896751 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.896651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.898245 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.897121 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.898245 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.897374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.898245 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.898109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.898245 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.898164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.899486 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.899152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.899576 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.899555 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.899803 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.899776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-config\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.900266 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.900243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.900514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.900484 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.900751 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.900721 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.901763 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.901741 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.901763 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.901754 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.902258 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.902237 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.902876 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.902852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.907086 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.907061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cqcf\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-kube-api-access-2cqcf\") pod \"prometheus-k8s-0\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:08.985773 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:08.985681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:09.181447 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:09.181374 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:03:09.186926 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:03:09.186870 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda497a995_2a6f_4046_9cf3_e4c7865716d6.slice/crio-19099c265ceae744a1ad223f3a6da4dc973811b8163a7ec8c5bc7754dd53ff32 WatchSource:0}: Error finding container 19099c265ceae744a1ad223f3a6da4dc973811b8163a7ec8c5bc7754dd53ff32: Status 404 returned error can't find the container with id 19099c265ceae744a1ad223f3a6da4dc973811b8163a7ec8c5bc7754dd53ff32 Jul 29 15:03:09.428401 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:09.426387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"19099c265ceae744a1ad223f3a6da4dc973811b8163a7ec8c5bc7754dd53ff32"} Jul 29 15:03:10.433487 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:10.433454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"6ee818cca9d70be658e443c5dd92dab6d40c4ccba2059314d9f24062ba53f19b"} Jul 29 15:03:10.433924 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:10.433537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"35c090c040d64c80eec7427f7c97fb863d4755a5da344e461d7fae7ad14271fc"} Jul 29 15:03:10.433924 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:10.433564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"c85535d9246b14d26293ffad4928a455fb06891e527d4f049729a54456784bf0"} Jul 29 15:03:12.443925 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:12.443840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8wbs" event={"ID":"faa9b566-9bcb-4897-9692-bf65abf341cb","Type":"ContainerStarted","Data":"aa7fd43b1135783548d296e39bbbc12aa02cf01fdf416691a0c79b9690108b7d"} Jul 29 15:03:12.445692 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:12.445661 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" exitCode=0 Jul 29 15:03:12.445797 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:12.445734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} Jul 29 15:03:12.589557 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:12.589479 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v8wbs" podStartSLOduration=33.329014602 podStartE2EDuration="48.589457969s" totalImagesPullingTime="15.260443367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:02:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:12.509493184 +0000 UTC m=+88.156576224" watchObservedRunningTime="2026-07-29 15:03:12.589457969 +0000 UTC m=+88.236540999" Jul 29 15:03:13.454071 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:13.454028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"e83a8667acd2bcdac2f6d1568fd8a478ab4d936f0e2092fe049311bc2142a95a"} Jul 29 15:03:13.454535 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:13.454120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"921e072173bbdcf8908e2089a7d0ea43d3166ac6e3ff89e86e04acc2c22541df"} Jul 29 15:03:13.454535 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:13.454167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" event={"ID":"170fe77b-1691-40b0-b418-0a96edbe7137","Type":"ContainerStarted","Data":"5b2595d5cc0c860750a421b1d75e9481b7759e39f6a7b7f2c770044b069b71ed"} Jul 29 15:03:14.459033 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:14.458993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:15.466030 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.465995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} Jul 29 15:03:15.466365 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.466109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} Jul 29 15:03:15.466365 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.466152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} Jul 29 15:03:15.466365 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.466178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} Jul 29 15:03:15.466365 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.466202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} Jul 29 15:03:15.466365 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.466224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerStarted","Data":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} Jul 29 15:03:15.472457 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.472429 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" Jul 29 15:03:15.530169 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.530113 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58cd58788b-796qd" podStartSLOduration=5.214318196 podStartE2EDuration="9.530096725s" totalImagesPullingTime="4.315778529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:13.510256705 +0000 UTC m=+89.157339735" watchObservedRunningTime="2026-07-29 15:03:15.530096725 +0000 UTC m=+91.177179753" Jul 29 15:03:15.530338 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:15.530252 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.917122443 podStartE2EDuration="7.530244852s" totalImagesPullingTime="5.592800166s" totalInitContainerRuntime="20.322243ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:15.528481025 +0000 UTC m=+91.175564057" watchObservedRunningTime="2026-07-29 15:03:15.530244852 +0000 UTC m=+91.177327881" Jul 29 15:03:18.986829 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:18.986795 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:03:21.327416 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:03:21.327384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-svmx6" Jul 29 15:04:08.986428 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:08.986382 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:09.006082 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:09.006055 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:09.677144 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:09.677119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.086044 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086002 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:04:27.086514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086322 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="prometheus" containerID="cri-o://ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" gracePeriod=600 Jul 29 15:04:27.086514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086348 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy" containerID="cri-o://57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" gracePeriod=600 Jul 29 15:04:27.086514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086385 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" gracePeriod=600 Jul 29 15:04:27.086514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086396 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-web" containerID="cri-o://ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" gracePeriod=600 Jul 29 15:04:27.086514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086420 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="config-reloader" containerID="cri-o://1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" gracePeriod=600 Jul 29 15:04:27.086799 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.086358 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="thanos-sidecar" containerID="cri-o://4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" gracePeriod=600 Jul 29 15:04:27.334754 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.334724 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.425118 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425090 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-kube-rbac-proxy\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425118 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425121 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-0\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425141 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-tls\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425176 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-web-config\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425205 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-db\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425233 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-2\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425262 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-1\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425308 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425333 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-trusted-ca-bundle\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425364 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-metrics-client-ca\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425390 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-tls-assets\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-serving-certs-ca-bundle\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425446 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-config-out\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425476 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-grpc-tls\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425550 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-metrics-client-certs\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425574 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-kubelet-serving-ca-bundle\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425623 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cqcf\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-kube-api-access-2cqcf\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425652 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-config\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.425821 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425696 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-thanos-prometheus-http-client-file\") pod \"a497a995-2a6f-4046-9cf3-e4c7865716d6\" (UID: \"a497a995-2a6f-4046-9cf3-e4c7865716d6\") " Jul 29 15:04:27.428177 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425641 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.425647 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.426536 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.426562 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.426917 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.427021 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.427170 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.428129 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:27.428855 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.428824 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.429263 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.429234 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.429551 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.429524 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-config-out" (OuterVolumeSpecName: "config-out") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:04:27.429899 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.429875 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.430002 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.429908 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.430002 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.429969 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.430002 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.429992 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.430286 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.430265 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-kube-api-access-2cqcf" (OuterVolumeSpecName: "kube-api-access-2cqcf") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "kube-api-access-2cqcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:04:27.430286 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.430277 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:04:27.430849 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.430829 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.431246 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.431230 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-config" (OuterVolumeSpecName: "config") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.438903 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.438884 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-web-config" (OuterVolumeSpecName: "web-config") pod "a497a995-2a6f-4046-9cf3-e4c7865716d6" (UID: "a497a995-2a6f-4046-9cf3-e4c7865716d6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:27.526500 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526444 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cqcf\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-kube-api-access-2cqcf\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526500 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526493 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-config\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526500 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526507 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526500 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526516 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-kube-rbac-proxy\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526525 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526534 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526562 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-web-config\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526571 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-db\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526579 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526587 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526596 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526605 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526635 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-metrics-client-ca\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526643 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a497a995-2a6f-4046-9cf3-e4c7865716d6-tls-assets\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526651 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526660 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a497a995-2a6f-4046-9cf3-e4c7865716d6-config-out\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526668 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526676 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-grpc-tls\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526683 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a497a995-2a6f-4046-9cf3-e4c7865716d6-secret-metrics-client-certs\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.526792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.526691 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a497a995-2a6f-4046-9cf3-e4c7865716d6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728900 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" exitCode=0 Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728927 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" exitCode=0 Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728934 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" exitCode=0 Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728940 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" exitCode=0 Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728945 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" exitCode=0 Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728951 2578 generic.go:356] "Generic (PLEG): container finished" podID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" exitCode=0 Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728966 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.728979 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.728976 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729136 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729169 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} Jul 29 15:04:27.729498 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.729280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a497a995-2a6f-4046-9cf3-e4c7865716d6","Type":"ContainerDied","Data":"19099c265ceae744a1ad223f3a6da4dc973811b8163a7ec8c5bc7754dd53ff32"} Jul 29 15:04:27.737551 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.737534 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.744563 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.744548 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.750793 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.750777 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.753377 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.753355 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:04:27.758278 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.758264 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.758685 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.758665 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:04:27.764752 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.764735 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.771470 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.771451 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.777897 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.777876 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.778162 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.778142 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.778213 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778171 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} err="failed to get container status \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" Jul 29 15:04:27.778213 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778203 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.778407 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.778393 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.778443 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778410 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} err="failed to get container status \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" Jul 29 15:04:27.778443 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778423 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.778633 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.778602 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.778679 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778639 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} err="failed to get container status \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" Jul 29 15:04:27.778679 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778654 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.778853 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.778835 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.778891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778856 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} err="failed to get container status \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" Jul 29 15:04:27.778891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.778869 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.779076 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.779061 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.779113 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779078 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} err="failed to get container status \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" Jul 29 15:04:27.779113 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779092 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.779278 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.779264 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.779318 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779283 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} err="failed to get container status \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" Jul 29 15:04:27.779318 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779294 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.779518 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:04:27.779503 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.779567 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779519 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} err="failed to get container status \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" Jul 29 15:04:27.779567 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779530 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.779730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779714 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} err="failed to get container status \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" Jul 29 15:04:27.779730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779730 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.779905 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779889 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} err="failed to get container status \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" Jul 29 15:04:27.779905 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.779904 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.780106 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780090 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} err="failed to get container status \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" Jul 29 15:04:27.780143 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780107 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.780298 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780270 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} err="failed to get container status \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" Jul 29 15:04:27.780298 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780291 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.780520 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780505 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} err="failed to get container status \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" Jul 29 15:04:27.780569 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780521 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.780730 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780715 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} err="failed to get container status \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" Jul 29 15:04:27.780772 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780730 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.780934 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780916 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} err="failed to get container status \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" Jul 29 15:04:27.780934 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.780933 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.781162 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781143 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} err="failed to get container status \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" Jul 29 15:04:27.781210 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781163 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.781380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781362 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} err="failed to get container status \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" Jul 29 15:04:27.781429 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781381 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.781587 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781571 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} err="failed to get container status \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" Jul 29 15:04:27.781708 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781588 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.781856 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781839 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} err="failed to get container status \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" Jul 29 15:04:27.781902 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.781859 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.782095 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782075 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} err="failed to get container status \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" Jul 29 15:04:27.782165 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782095 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.782288 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782274 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} err="failed to get container status \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" Jul 29 15:04:27.782288 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782288 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.782485 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782470 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} err="failed to get container status \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" Jul 29 15:04:27.782485 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782484 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.782706 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782689 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} err="failed to get container status \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" Jul 29 15:04:27.782767 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782706 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.782891 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782876 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} err="failed to get container status \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" Jul 29 15:04:27.782939 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.782892 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.783107 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783089 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} err="failed to get container status \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" Jul 29 15:04:27.783107 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783107 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.783316 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783299 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} err="failed to get container status \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" Jul 29 15:04:27.783367 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783316 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.783489 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783474 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} err="failed to get container status \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" Jul 29 15:04:27.783533 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783489 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.783710 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783694 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} err="failed to get container status \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" Jul 29 15:04:27.783755 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783710 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.783916 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783899 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} err="failed to get container status \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" Jul 29 15:04:27.784039 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.783916 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.784134 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784117 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} err="failed to get container status \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" Jul 29 15:04:27.784175 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784135 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.784340 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784325 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} err="failed to get container status \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" Jul 29 15:04:27.784388 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784341 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.784546 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784525 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} err="failed to get container status \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" Jul 29 15:04:27.784596 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784546 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.784947 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784916 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} err="failed to get container status \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" Jul 29 15:04:27.784947 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.784943 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.785220 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785189 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} err="failed to get container status \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" Jul 29 15:04:27.785220 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785218 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.785472 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785444 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} err="failed to get container status \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" Jul 29 15:04:27.785472 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785463 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.785727 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785706 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} err="failed to get container status \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" Jul 29 15:04:27.785850 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785728 2578 scope.go:117] "RemoveContainer" containerID="8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919" Jul 29 15:04:27.786005 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.785976 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919"} err="failed to get container status \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": rpc error: code = NotFound desc = could not find container \"8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919\": container with ID starting with 8cb2083d3443576cb73649de5e12f176f0f8132743fa1f4dcf36b9ae2ebfc919 not found: ID does not exist" Jul 29 15:04:27.786093 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786006 2578 scope.go:117] "RemoveContainer" containerID="57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6" Jul 29 15:04:27.786394 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786375 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6"} err="failed to get container status \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": rpc error: code = NotFound desc = could not find container \"57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6\": container with ID starting with 57371cf3b26db525bdaafaa979cc248816a7f3b591a828b6d9721de39d16f1d6 not found: ID does not exist" Jul 29 15:04:27.786394 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786392 2578 scope.go:117] "RemoveContainer" containerID="ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28" Jul 29 15:04:27.786639 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786601 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28"} err="failed to get container status \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": rpc error: code = NotFound desc = could not find container \"ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28\": container with ID starting with ce63622ef5e836b76151409ea9679119946136fd57a2503926980d136c066b28 not found: ID does not exist" Jul 29 15:04:27.786698 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786641 2578 scope.go:117] "RemoveContainer" containerID="4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7" Jul 29 15:04:27.786698 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786654 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:04:27.786846 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786831 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7"} err="failed to get container status \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": rpc error: code = NotFound desc = could not find container \"4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7\": container with ID starting with 4a74e9b94bd820c67a817052db48d8b1fae3385320560ee78f94c6069e018ca7 not found: ID does not exist" Jul 29 15:04:27.786846 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786845 2578 scope.go:117] "RemoveContainer" containerID="1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c" Jul 29 15:04:27.786936 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786923 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy" Jul 29 15:04:27.786986 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786937 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy" Jul 29 15:04:27.786986 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786954 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="init-config-reloader" Jul 29 15:04:27.786986 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786960 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="init-config-reloader" Jul 29 15:04:27.786986 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786967 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="thanos-sidecar" Jul 29 15:04:27.786986 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786976 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="thanos-sidecar" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786989 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-thanos" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.786995 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-thanos" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787008 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="config-reloader" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787014 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="config-reloader" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787020 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="prometheus" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787025 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="prometheus" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787032 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-web" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787037 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-web" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787037 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c"} err="failed to get container status \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": rpc error: code = NotFound desc = could not find container \"1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c\": container with ID starting with 1460a616a3beab351026cbe48dbf285507b799f2b4c3b526f260fca8fdb93f1c not found: ID does not exist" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787052 2578 scope.go:117] "RemoveContainer" containerID="ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787083 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787092 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="thanos-sidecar" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787098 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="prometheus" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787103 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-web" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787110 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="config-reloader" Jul 29 15:04:27.787182 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787114 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" containerName="kube-rbac-proxy-thanos" Jul 29 15:04:27.787700 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787266 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051"} err="failed to get container status \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": rpc error: code = NotFound desc = could not find container \"ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051\": container with ID starting with ac660ea9511433ab3850a9a8b03bbda18400d2a9ba672ed10730a655e8f1e051 not found: ID does not exist" Jul 29 15:04:27.787700 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787278 2578 scope.go:117] "RemoveContainer" containerID="4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b" Jul 29 15:04:27.787700 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.787453 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b"} err="failed to get container status \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": rpc error: code = NotFound desc = could not find container \"4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b\": container with ID starting with 4c8d55379558effc3ed65fc9722e59145246f7db2da197d241a50af3c7fa537b not found: ID does not exist" Jul 29 15:04:27.790712 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.790695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.792923 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.792877 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 15:04:27.793092 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793056 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 15:04:27.793310 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793293 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 15:04:27.793380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793316 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:04:27.793380 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793295 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 15:04:27.793625 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793591 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 15:04:27.793691 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793642 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 15:04:27.793731 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 15:04:27.793731 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.793696 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 15:04:27.794040 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.794023 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bke94o9ce4bt2\"" Jul 29 15:04:27.794119 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.794026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 15:04:27.794361 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.794343 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 15:04:27.794440 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.794357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 15:04:27.794522 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.794507 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 15:04:27.794568 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.794549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k99mn\"" Jul 29 15:04:27.798267 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.797724 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 15:04:27.801758 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.801740 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 15:04:27.808953 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.808934 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:04:27.929277 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929277 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4sl\" (UniqueName: \"kubernetes.io/projected/5f155557-ed86-4fed-a1a8-ca15fffb829e-kube-api-access-nk4sl\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929494 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f155557-ed86-4fed-a1a8-ca15fffb829e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f155557-ed86-4fed-a1a8-ca15fffb829e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-config\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:27.929913 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:27.929709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.030956 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.030862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.030956 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.030913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.030956 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.030937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.030956 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.030965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031248 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031248 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031248 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031248 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031248 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031248 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f155557-ed86-4fed-a1a8-ca15fffb829e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031526 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f155557-ed86-4fed-a1a8-ca15fffb829e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031817 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031817 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-config\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031817 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031817 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031817 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.031817 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4sl\" (UniqueName: \"kubernetes.io/projected/5f155557-ed86-4fed-a1a8-ca15fffb829e-kube-api-access-nk4sl\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.032105 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031832 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.032105 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.031955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.033766 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.032605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.033766 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.032660 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.033766 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.033294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.034223 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.034188 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.034312 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.034285 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.034990 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.034496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.034990 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.034926 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.035141 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.035068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f155557-ed86-4fed-a1a8-ca15fffb829e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.035141 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.035090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.035782 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.035306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f155557-ed86-4fed-a1a8-ca15fffb829e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.035782 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.035742 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.035932 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.035903 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.037048 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.037027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-config\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.037134 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.037075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f155557-ed86-4fed-a1a8-ca15fffb829e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.037134 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.037089 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.037134 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.037097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f155557-ed86-4fed-a1a8-ca15fffb829e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.039999 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.039983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4sl\" (UniqueName: \"kubernetes.io/projected/5f155557-ed86-4fed-a1a8-ca15fffb829e-kube-api-access-nk4sl\") pod \"prometheus-k8s-0\" (UID: \"5f155557-ed86-4fed-a1a8-ca15fffb829e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.101629 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.101586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:04:28.256310 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.256287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 15:04:28.258300 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:04:28.258262 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f155557_ed86_4fed_a1a8_ca15fffb829e.slice/crio-ffd4f6d429a1aa3d1ecdedcfefd0d525f1876dd8b3fc5a8b92abe97e8d1e317e WatchSource:0}: Error finding container ffd4f6d429a1aa3d1ecdedcfefd0d525f1876dd8b3fc5a8b92abe97e8d1e317e: Status 404 returned error can't find the container with id ffd4f6d429a1aa3d1ecdedcfefd0d525f1876dd8b3fc5a8b92abe97e8d1e317e Jul 29 15:04:28.736852 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.736817 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f155557-ed86-4fed-a1a8-ca15fffb829e" containerID="a0c54a0e27e4a37cf42726159140b66562c7a44aa1004f1252eb5d20e5fdee56" exitCode=0 Jul 29 15:04:28.737039 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.736907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerDied","Data":"a0c54a0e27e4a37cf42726159140b66562c7a44aa1004f1252eb5d20e5fdee56"} Jul 29 15:04:28.737039 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.737029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"ffd4f6d429a1aa3d1ecdedcfefd0d525f1876dd8b3fc5a8b92abe97e8d1e317e"} Jul 29 15:04:28.946514 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:28.946481 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a497a995-2a6f-4046-9cf3-e4c7865716d6" path="/var/lib/kubelet/pods/a497a995-2a6f-4046-9cf3-e4c7865716d6/volumes" Jul 29 15:04:29.747449 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.747419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"db1c49902310cf3e80ee1554fea519f1a801c8e5c21a577bac9999dd7c88c3c1"} Jul 29 15:04:29.747857 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.747484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"4d493a709ff16c4896af62795eaea7f48ab648f5930273d799c8d641d924f659"} Jul 29 15:04:29.747857 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.747510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"63cad7272cd6c643b9765974e78ba988b9ffb3b9f55617a9f7229bf471909965"} Jul 29 15:04:29.747857 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.747533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"1f811836661c348468a8643959c8b1cc3b510f884f948fb5373fc342bb812b28"} Jul 29 15:04:29.747857 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.747562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"74f8018acfa1fd079331c0f650ae2b15f72f72cb72747b22a06138c3660b8f73"} Jul 29 15:04:29.747857 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.747585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5f155557-ed86-4fed-a1a8-ca15fffb829e","Type":"ContainerStarted","Data":"2ebafc7742415c6fada96f1a92a406e5b5a206125acafeaf076b7db7aa04b592"} Jul 29 15:04:29.777411 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:29.777357 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.758569477 podStartE2EDuration="2.77733666s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.767183ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:04:29.775431476 +0000 UTC m=+165.422514504" watchObservedRunningTime="2026-07-29 15:04:29.77733666 +0000 UTC m=+165.424419691" Jul 29 15:04:33.102002 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:04:33.101965 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:05:28.102801 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:05:28.102758 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:05:28.117909 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:05:28.117877 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:05:28.971267 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:05:28.971239 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 15:06:44.731061 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:06:44.731031 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:09:29.726129 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.726095 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-rrd7r"] Jul 29 15:09:29.728517 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.728494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:29.730829 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.730805 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 15:09:29.731778 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.731760 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-zl9xx\"" Jul 29 15:09:29.731976 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.731764 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 15:09:29.732086 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.731771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 15:09:29.743100 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.743077 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-rrd7r"] Jul 29 15:09:29.816628 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.816574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5489543-016d-4f01-97c2-9f7b8b1be092-cert\") pod \"llmisvc-controller-manager-654c557856-rrd7r\" (UID: \"b5489543-016d-4f01-97c2-9f7b8b1be092\") " pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:29.816792 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.816664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4khl4\" (UniqueName: \"kubernetes.io/projected/b5489543-016d-4f01-97c2-9f7b8b1be092-kube-api-access-4khl4\") pod \"llmisvc-controller-manager-654c557856-rrd7r\" (UID: \"b5489543-016d-4f01-97c2-9f7b8b1be092\") " pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:29.917398 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.917353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4khl4\" (UniqueName: \"kubernetes.io/projected/b5489543-016d-4f01-97c2-9f7b8b1be092-kube-api-access-4khl4\") pod \"llmisvc-controller-manager-654c557856-rrd7r\" (UID: \"b5489543-016d-4f01-97c2-9f7b8b1be092\") " pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:29.917584 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.917453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5489543-016d-4f01-97c2-9f7b8b1be092-cert\") pod \"llmisvc-controller-manager-654c557856-rrd7r\" (UID: \"b5489543-016d-4f01-97c2-9f7b8b1be092\") " pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:29.920078 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.920044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5489543-016d-4f01-97c2-9f7b8b1be092-cert\") pod \"llmisvc-controller-manager-654c557856-rrd7r\" (UID: \"b5489543-016d-4f01-97c2-9f7b8b1be092\") " pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:29.929357 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:29.929328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4khl4\" (UniqueName: \"kubernetes.io/projected/b5489543-016d-4f01-97c2-9f7b8b1be092-kube-api-access-4khl4\") pod \"llmisvc-controller-manager-654c557856-rrd7r\" (UID: \"b5489543-016d-4f01-97c2-9f7b8b1be092\") " pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:30.040027 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:30.039917 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:30.167102 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:30.167072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-rrd7r"] Jul 29 15:09:30.170153 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:09:30.170124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb5489543_016d_4f01_97c2_9f7b8b1be092.slice/crio-f9d00c56fbc34bfe90b452a867325edcd8b26e934be84449d05028d6b365e86b WatchSource:0}: Error finding container f9d00c56fbc34bfe90b452a867325edcd8b26e934be84449d05028d6b365e86b: Status 404 returned error can't find the container with id f9d00c56fbc34bfe90b452a867325edcd8b26e934be84449d05028d6b365e86b Jul 29 15:09:30.171732 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:30.171714 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:09:30.843034 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:30.843005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerStarted","Data":"f9d00c56fbc34bfe90b452a867325edcd8b26e934be84449d05028d6b365e86b"} Jul 29 15:09:34.861015 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:34.860984 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="996f1c72b42a1ece5a4c16379fbe53307e8ec31c3fc946b79594c79621c147f0" exitCode=1 Jul 29 15:09:34.861335 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:34.861068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"996f1c72b42a1ece5a4c16379fbe53307e8ec31c3fc946b79594c79621c147f0"} Jul 29 15:09:34.861335 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:34.861220 2578 scope.go:117] "RemoveContainer" containerID="996f1c72b42a1ece5a4c16379fbe53307e8ec31c3fc946b79594c79621c147f0" Jul 29 15:09:35.040591 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:35.040557 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:35.865936 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:35.865899 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerStarted","Data":"6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f"} Jul 29 15:09:35.866371 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:35.866019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:35.881356 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:35.881306 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podStartSLOduration=2.642226399 podStartE2EDuration="6.881278265s" totalImagesPullingTime="4.239051866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:09:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:09:35.880131965 +0000 UTC m=+471.527214993" watchObservedRunningTime="2026-07-29 15:09:35.881278265 +0000 UTC m=+471.528361294" Jul 29 15:09:36.871326 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:36.871292 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f" exitCode=1 Jul 29 15:09:36.871725 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:36.871358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f"} Jul 29 15:09:36.871725 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:36.871402 2578 scope.go:117] "RemoveContainer" containerID="996f1c72b42a1ece5a4c16379fbe53307e8ec31c3fc946b79594c79621c147f0" Jul 29 15:09:36.871725 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:36.871564 2578 scope.go:117] "RemoveContainer" containerID="6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f" Jul 29 15:09:36.871860 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:09:36.871759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:09:37.877044 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:37.877019 2578 scope.go:117] "RemoveContainer" containerID="6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f" Jul 29 15:09:37.877424 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:09:37.877176 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:09:40.040989 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:40.040951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:40.041469 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:40.041403 2578 scope.go:117] "RemoveContainer" containerID="6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f" Jul 29 15:09:40.041640 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:09:40.041598 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:09:52.936083 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:52.936050 2578 scope.go:117] "RemoveContainer" containerID="6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f" Jul 29 15:09:53.936591 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:53.936557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerStarted","Data":"9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f"} Jul 29 15:09:53.937050 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:53.936798 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:09:54.942502 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:54.942472 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" exitCode=1 Jul 29 15:09:54.942957 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:54.942509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f"} Jul 29 15:09:54.942957 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:54.942548 2578 scope.go:117] "RemoveContainer" containerID="6cb81255a23d9f05005b3e4ee69234317d9db2386d50a0e2009c3093f107c41f" Jul 29 15:09:54.942957 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:54.942796 2578 scope.go:117] "RemoveContainer" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" Jul 29 15:09:54.943113 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:09:54.942990 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:09:55.947311 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:09:55.947283 2578 scope.go:117] "RemoveContainer" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" Jul 29 15:09:55.947695 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:09:55.947483 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:10:00.040944 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:00.040904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:10:00.041357 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:00.041278 2578 scope.go:117] "RemoveContainer" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" Jul 29 15:10:00.041462 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:10:00.041441 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:10:13.936183 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:13.936146 2578 scope.go:117] "RemoveContainer" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" Jul 29 15:10:13.936769 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:10:13.936407 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:10:28.935911 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:28.935875 2578 scope.go:117] "RemoveContainer" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" Jul 29 15:10:30.072691 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:30.072657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerStarted","Data":"578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532"} Jul 29 15:10:30.073125 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:30.072958 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:10:31.078309 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:31.078274 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" exitCode=1 Jul 29 15:10:31.078762 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:31.078329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532"} Jul 29 15:10:31.078762 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:31.078377 2578 scope.go:117] "RemoveContainer" containerID="9ae9f34a14f07a582188197338c50907d30fcbea793da9560b4205b09ea7831f" Jul 29 15:10:31.078762 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:31.078578 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:10:31.078881 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:10:31.078819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:10:32.084769 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:32.084738 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:10:32.085149 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:10:32.084945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:10:40.040392 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:40.040304 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:10:40.040760 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:40.040691 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:10:40.040872 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:10:40.040852 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:10:51.936168 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:10:51.936131 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:10:51.936668 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:10:51.936303 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:11:04.937713 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:04.937683 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:11:04.938205 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:11:04.937911 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:11:18.935990 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:18.935952 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:11:20.270423 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:20.270387 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" exitCode=1 Jul 29 15:11:20.270423 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:20.270422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217"} Jul 29 15:11:20.270887 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:20.270470 2578 scope.go:117] "RemoveContainer" containerID="578c068327ef96f0a6de67827f64739cccf027e224375a56c0e915d19934c532" Jul 29 15:11:20.270887 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:20.270832 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:11:20.271055 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:11:20.271032 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:11:25.073805 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:25.073750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:11:25.074302 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:25.074147 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:11:25.074348 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:11:25.074307 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:11:30.040570 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:30.040534 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:11:30.040976 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:30.040942 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:11:30.041132 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:11:30.041113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:11:42.936104 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:42.936063 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:11:42.936644 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:11:42.936300 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:11:55.936262 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:11:55.936223 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:11:55.936768 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:11:55.936450 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:12:09.935777 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:09.935693 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:12:09.936322 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:12:09.935945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:12:24.938056 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:24.938027 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:12:24.938533 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:12:24.938194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:12:39.936320 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:39.936293 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:12:39.936711 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:12:39.936471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:12:51.936082 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:51.936042 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:12:54.626187 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:54.626153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerStarted","Data":"cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066"} Jul 29 15:12:54.626634 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:54.626370 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:12:55.631888 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:55.631849 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" exitCode=1 Jul 29 15:12:55.632318 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:55.631931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066"} Jul 29 15:12:55.632318 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:55.631993 2578 scope.go:117] "RemoveContainer" containerID="d89c139300a02141486aee24323b1d7211efe5fabe7cc12ba9279d28584d6217" Jul 29 15:12:55.632318 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:55.632199 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:12:55.632448 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:12:55.632376 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:12:56.638199 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:12:56.638169 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:12:56.638579 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:12:56.638345 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:13:00.040363 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:13:00.040323 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:13:00.040778 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:13:00.040708 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:13:00.040894 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:13:00.040874 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:13:11.936282 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:13:11.936246 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:13:11.936721 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:13:11.936406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:13:22.936552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:13:22.936522 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:13:22.937090 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:13:22.936709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:13:34.938186 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:13:34.938152 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:13:34.938699 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:13:34.938351 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:13:49.935995 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:13:49.935920 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:13:49.936361 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:13:49.936106 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:14:04.937588 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:14:04.937556 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:14:04.938002 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:14:04.937730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:14:19.936204 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:14:19.936173 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:14:19.936706 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:14:19.936332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:14:33.936084 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:14:33.936047 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:14:33.936542 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:14:33.936268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:14:47.936550 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:14:47.936513 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:14:47.936961 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:14:47.936720 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:01.935885 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:01.935856 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:15:01.936483 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:01.936026 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:12.936451 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:12.936374 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:15:12.936903 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:12.936552 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:23.936054 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:23.936024 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:15:23.936445 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:23.936215 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:34.942802 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:34.942774 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:15:34.943328 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:34.943065 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:15:38.220084 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:38.220046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerStarted","Data":"483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218"} Jul 29 15:15:38.220471 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:38.220349 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:15:39.225855 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:39.225821 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5489543-016d-4f01-97c2-9f7b8b1be092" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" exitCode=1 Jul 29 15:15:39.226233 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:39.225886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" event={"ID":"b5489543-016d-4f01-97c2-9f7b8b1be092","Type":"ContainerDied","Data":"483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218"} Jul 29 15:15:39.226233 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:39.225947 2578 scope.go:117] "RemoveContainer" containerID="cced2eec6b57f23a896172d8fefde17d4f666a4738821cd82cb2b837d1c2e066" Jul 29 15:15:39.226233 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:39.226139 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:15:39.226356 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:39.226328 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:40.040749 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:40.040714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" Jul 29 15:15:40.230666 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:40.230636 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:15:40.231070 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:40.230840 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:41.234360 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:41.234336 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:15:41.234754 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:41.234497 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:15:52.936272 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:15:52.936235 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:15:52.936745 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:15:52.936455 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:16:03.936183 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:16:03.936151 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:16:03.936560 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:16:03.936311 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:16:14.938890 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:16:14.938860 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:16:14.939299 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:16:14.939038 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:16:27.936487 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:16:27.936452 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:16:27.936960 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:16:27.936646 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:16:41.935808 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:16:41.935728 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:16:41.936174 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:16:41.935914 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:16:53.936489 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:16:53.936454 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:16:53.936926 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:16:53.936649 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:17:05.936344 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:17:05.936313 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:17:05.936820 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:17:05.936486 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:17:20.936465 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:17:20.936426 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:17:20.936992 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:17:20.936603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:17:35.936445 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:17:35.936411 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:17:35.938685 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:17:35.936572 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:17:46.936265 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:17:46.936225 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:17:46.936752 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:17:46.936390 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:17:59.936258 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:17:59.936225 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:17:59.936667 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:17:59.936398 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:18:14.938178 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:18:14.938102 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:18:14.938553 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:18:14.938259 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:18:25.936332 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:18:25.936297 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:18:25.936831 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:18:25.936482 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:18:40.936262 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:18:40.936225 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:18:40.936647 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:18:40.936416 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:18:51.936485 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:18:51.936449 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:18:51.936909 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:18:51.936583 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:19:05.935728 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:05.935693 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:19:05.936177 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:19:05.935866 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:19:19.935692 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:19.935659 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:19:19.936062 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:19:19.935843 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:19:34.937386 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:34.937354 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:19:34.937804 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:19:34.937629 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:19:36.024407 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:36.024337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-rrd7r_b5489543-016d-4f01-97c2-9f7b8b1be092/manager/6.log" Jul 29 15:19:39.832632 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.832582 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g94cr/must-gather-fkbkd"] Jul 29 15:19:39.836041 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.836013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:39.839159 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.839134 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g94cr\"/\"kube-root-ca.crt\"" Jul 29 15:19:39.839352 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.839135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g94cr\"/\"default-dockercfg-77dbs\"" Jul 29 15:19:39.839352 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.839155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g94cr\"/\"openshift-service-ca.crt\"" Jul 29 15:19:39.858347 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.858321 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g94cr/must-gather-fkbkd"] Jul 29 15:19:39.933560 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.933521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs76b\" (UniqueName: \"kubernetes.io/projected/0a0dc618-8c5a-41e5-9151-9167573a5858-kube-api-access-fs76b\") pod \"must-gather-fkbkd\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:39.933776 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:39.933572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a0dc618-8c5a-41e5-9151-9167573a5858-must-gather-output\") pod \"must-gather-fkbkd\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:40.034332 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:40.034291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs76b\" (UniqueName: \"kubernetes.io/projected/0a0dc618-8c5a-41e5-9151-9167573a5858-kube-api-access-fs76b\") pod \"must-gather-fkbkd\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:40.034332 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:40.034336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a0dc618-8c5a-41e5-9151-9167573a5858-must-gather-output\") pod \"must-gather-fkbkd\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:40.034805 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:40.034779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a0dc618-8c5a-41e5-9151-9167573a5858-must-gather-output\") pod \"must-gather-fkbkd\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:40.043040 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:40.043010 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs76b\" (UniqueName: \"kubernetes.io/projected/0a0dc618-8c5a-41e5-9151-9167573a5858-kube-api-access-fs76b\") pod \"must-gather-fkbkd\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:40.153671 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:40.153638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:19:40.279690 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:40.279656 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g94cr/must-gather-fkbkd"] Jul 29 15:19:40.283037 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:19:40.283005 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a0dc618_8c5a_41e5_9151_9167573a5858.slice/crio-4cd7ecf5934b1cc8c8ce929c3a0933bcdc2ce0b6f89ea11a0661703454619d0b WatchSource:0}: Error finding container 4cd7ecf5934b1cc8c8ce929c3a0933bcdc2ce0b6f89ea11a0661703454619d0b: Status 404 returned error can't find the container with id 4cd7ecf5934b1cc8c8ce929c3a0933bcdc2ce0b6f89ea11a0661703454619d0b Jul 29 15:19:41.096553 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:41.096510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g94cr/must-gather-fkbkd" event={"ID":"0a0dc618-8c5a-41e5-9151-9167573a5858","Type":"ContainerStarted","Data":"4cd7ecf5934b1cc8c8ce929c3a0933bcdc2ce0b6f89ea11a0661703454619d0b"} Jul 29 15:19:46.936179 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:46.936146 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:19:46.936631 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:19:46.936394 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:19:47.124502 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:47.124467 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g94cr/must-gather-fkbkd" event={"ID":"0a0dc618-8c5a-41e5-9151-9167573a5858","Type":"ContainerStarted","Data":"00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9"} Jul 29 15:19:47.124708 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:47.124514 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g94cr/must-gather-fkbkd" event={"ID":"0a0dc618-8c5a-41e5-9151-9167573a5858","Type":"ContainerStarted","Data":"105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6"} Jul 29 15:19:47.151629 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:47.151562 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g94cr/must-gather-fkbkd" podStartSLOduration=2.153796532 podStartE2EDuration="8.151545116s" totalImagesPullingTime="5.997748584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:19:47.150519472 +0000 UTC m=+1082.797602500" watchObservedRunningTime="2026-07-29 15:19:47.151545116 +0000 UTC m=+1082.798628167" Jul 29 15:19:58.935925 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:58.935895 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:19:58.936380 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:19:58.936066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:19:59.175583 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:59.175549 2578 generic.go:356] "Generic (PLEG): container finished" podID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerID="105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6" exitCode=0 Jul 29 15:19:59.175800 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:59.175644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g94cr/must-gather-fkbkd" event={"ID":"0a0dc618-8c5a-41e5-9151-9167573a5858","Type":"ContainerDied","Data":"105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6"} Jul 29 15:19:59.176023 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:59.176007 2578 scope.go:117] "RemoveContainer" containerID="105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6" Jul 29 15:19:59.985718 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:19:59.985687 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-g94cr_must-gather-fkbkd_0a0dc618-8c5a-41e5-9151-9167573a5858/gather/0.log" Jul 29 15:20:03.992073 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:03.992043 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kxdmt_3fec9098-a15b-4612-b7bf-c86bec53940e/global-pull-secret-syncer/0.log" Jul 29 15:20:04.113674 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:04.113642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xm7jr_6a7509ff-e248-4dcc-b8be-ba3c3415aa5a/konnectivity-agent/0.log" Jul 29 15:20:04.164816 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:04.164788 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-24.ec2.internal_d1c0f72c3273df0441814885d9a57b24/haproxy/0.log" Jul 29 15:20:05.287559 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.287524 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-g94cr/must-gather-fkbkd"] Jul 29 15:20:05.287964 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.287748 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-g94cr/must-gather-fkbkd" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="copy" containerID="cri-o://00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9" gracePeriod=2 Jul 29 15:20:05.294572 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.294545 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-g94cr/must-gather-fkbkd"] Jul 29 15:20:05.295930 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:05.295894 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a0dc618-8c5a-41e5-9151-9167573a5858\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-g94cr\"/\"must-gather-fkbkd\": pods \"must-gather-fkbkd\" not found" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:20:05.515796 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.515771 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-g94cr_must-gather-fkbkd_0a0dc618-8c5a-41e5-9151-9167573a5858/copy/0.log" Jul 29 15:20:05.517424 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.517406 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:20:05.519521 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:05.519498 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fkbkd\" is forbidden: User \"system:node:ip-10-0-130-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-g94cr\": no relationship found between node 'ip-10-0-130-24.ec2.internal' and this object" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:20:05.543096 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.543028 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs76b\" (UniqueName: \"kubernetes.io/projected/0a0dc618-8c5a-41e5-9151-9167573a5858-kube-api-access-fs76b\") pod \"0a0dc618-8c5a-41e5-9151-9167573a5858\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " Jul 29 15:20:05.543178 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.543102 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a0dc618-8c5a-41e5-9151-9167573a5858-must-gather-output\") pod \"0a0dc618-8c5a-41e5-9151-9167573a5858\" (UID: \"0a0dc618-8c5a-41e5-9151-9167573a5858\") " Jul 29 15:20:05.543466 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.543446 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a0dc618-8c5a-41e5-9151-9167573a5858-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "0a0dc618-8c5a-41e5-9151-9167573a5858" (UID: "0a0dc618-8c5a-41e5-9151-9167573a5858"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:20:05.545181 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.545161 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a0dc618-8c5a-41e5-9151-9167573a5858-kube-api-access-fs76b" (OuterVolumeSpecName: "kube-api-access-fs76b") pod "0a0dc618-8c5a-41e5-9151-9167573a5858" (UID: "0a0dc618-8c5a-41e5-9151-9167573a5858"). InnerVolumeSpecName "kube-api-access-fs76b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:20:05.644092 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.644053 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs76b\" (UniqueName: \"kubernetes.io/projected/0a0dc618-8c5a-41e5-9151-9167573a5858-kube-api-access-fs76b\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:20:05.644092 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:05.644085 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a0dc618-8c5a-41e5-9151-9167573a5858-must-gather-output\") on node \"ip-10-0-130-24.ec2.internal\" DevicePath \"\"" Jul 29 15:20:06.200833 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.200808 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-g94cr_must-gather-fkbkd_0a0dc618-8c5a-41e5-9151-9167573a5858/copy/0.log" Jul 29 15:20:06.201160 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.201130 2578 generic.go:356] "Generic (PLEG): container finished" podID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerID="00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9" exitCode=143 Jul 29 15:20:06.201227 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.201180 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:20:06.201227 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.201191 2578 scope.go:117] "RemoveContainer" containerID="00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9" Jul 29 15:20:06.203779 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:06.203756 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fkbkd\" is forbidden: User \"system:node:ip-10-0-130-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-g94cr\": no relationship found between node 'ip-10-0-130-24.ec2.internal' and this object" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:20:06.209057 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.209038 2578 scope.go:117] "RemoveContainer" containerID="105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6" Jul 29 15:20:06.210936 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:06.210912 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fkbkd\" is forbidden: User \"system:node:ip-10-0-130-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-g94cr\": no relationship found between node 'ip-10-0-130-24.ec2.internal' and this object" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" pod="openshift-must-gather-g94cr/must-gather-fkbkd" Jul 29 15:20:06.221046 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.221032 2578 scope.go:117] "RemoveContainer" containerID="00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9" Jul 29 15:20:06.221304 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:06.221277 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9\": container with ID starting with 00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9 not found: ID does not exist" containerID="00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9" Jul 29 15:20:06.221388 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.221316 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9"} err="failed to get container status \"00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9\": rpc error: code = NotFound desc = could not find container \"00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9\": container with ID starting with 00cc580013770eddd594881af60ef381b992fff514932712ac59ef458cf3c0c9 not found: ID does not exist" Jul 29 15:20:06.221388 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.221343 2578 scope.go:117] "RemoveContainer" containerID="105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6" Jul 29 15:20:06.221630 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:06.221594 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6\": container with ID starting with 105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6 not found: ID does not exist" containerID="105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6" Jul 29 15:20:06.221694 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.221635 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6"} err="failed to get container status \"105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6\": rpc error: code = NotFound desc = could not find container \"105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6\": container with ID starting with 105470a149d985a31d628dcdd2238b94a99bd4df38a75c019f7843bd4075b6d6 not found: ID does not exist" Jul 29 15:20:06.940261 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:06.940230 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" path="/var/lib/kubelet/pods/0a0dc618-8c5a-41e5-9151-9167573a5858/volumes" Jul 29 15:20:08.954444 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:08.954418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcc79_faf34d6a-77d8-4da9-bfb9-8f30435062c8/node-exporter/0.log" Jul 29 15:20:08.974241 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:08.974221 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcc79_faf34d6a-77d8-4da9-bfb9-8f30435062c8/kube-rbac-proxy/0.log" Jul 29 15:20:08.995599 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:08.995577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcc79_faf34d6a-77d8-4da9-bfb9-8f30435062c8/init-textfile/0.log" Jul 29 15:20:09.267216 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.267144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/prometheus/0.log" Jul 29 15:20:09.298627 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.295689 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/config-reloader/0.log" Jul 29 15:20:09.320071 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.320039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/thanos-sidecar/0.log" Jul 29 15:20:09.340108 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.340086 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/kube-rbac-proxy-web/0.log" Jul 29 15:20:09.360750 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.360724 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/kube-rbac-proxy/0.log" Jul 29 15:20:09.382393 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.382365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/kube-rbac-proxy-thanos/0.log" Jul 29 15:20:09.407213 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.407189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5f155557-ed86-4fed-a1a8-ca15fffb829e/init-config-reloader/0.log" Jul 29 15:20:09.437605 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.437580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wkltg_e1db0bad-c2e6-4c5a-b44b-901839b22d54/prometheus-operator/0.log" Jul 29 15:20:09.467802 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.467767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wkltg_e1db0bad-c2e6-4c5a-b44b-901839b22d54/kube-rbac-proxy/0.log" Jul 29 15:20:09.495083 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.495052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-bzg4v_51b158cc-c858-496b-bd88-058edd7c1982/prometheus-operator-admission-webhook/0.log" Jul 29 15:20:09.631630 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.631581 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58cd58788b-796qd_170fe77b-1691-40b0-b418-0a96edbe7137/thanos-query/0.log" Jul 29 15:20:09.663234 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.663212 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58cd58788b-796qd_170fe77b-1691-40b0-b418-0a96edbe7137/kube-rbac-proxy-web/0.log" Jul 29 15:20:09.690063 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.690042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58cd58788b-796qd_170fe77b-1691-40b0-b418-0a96edbe7137/kube-rbac-proxy/0.log" Jul 29 15:20:09.722201 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.722170 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58cd58788b-796qd_170fe77b-1691-40b0-b418-0a96edbe7137/prom-label-proxy/0.log" Jul 29 15:20:09.750903 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.750876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58cd58788b-796qd_170fe77b-1691-40b0-b418-0a96edbe7137/kube-rbac-proxy-rules/0.log" Jul 29 15:20:09.781928 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.781903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58cd58788b-796qd_170fe77b-1691-40b0-b418-0a96edbe7137/kube-rbac-proxy-metrics/0.log" Jul 29 15:20:09.936085 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:09.936004 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:20:09.936242 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:09.936175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:20:10.895839 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:10.895813 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-rmvmn_486eb785-9dac-4934-bc42-4771936cb9dd/networking-console-plugin/0.log" Jul 29 15:20:13.381309 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381271 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp"] Jul 29 15:20:13.381715 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381571 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="copy" Jul 29 15:20:13.381715 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381582 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="copy" Jul 29 15:20:13.381715 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381598 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="gather" Jul 29 15:20:13.381715 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381604 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="gather" Jul 29 15:20:13.381715 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381669 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="copy" Jul 29 15:20:13.381715 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.381679 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a0dc618-8c5a-41e5-9151-9167573a5858" containerName="gather" Jul 29 15:20:13.383449 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.383425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.385907 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.385887 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7g5l2\"/\"kube-root-ca.crt\"" Jul 29 15:20:13.386310 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.386286 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7g5l2\"/\"openshift-service-ca.crt\"" Jul 29 15:20:13.386729 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.386716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7g5l2\"/\"default-dockercfg-xxrpk\"" Jul 29 15:20:13.403243 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.403221 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp"] Jul 29 15:20:13.468934 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.468905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t7nmv_4a4b5378-11da-46ea-87af-018478037927/dns/0.log" Jul 29 15:20:13.498951 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.498918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t7nmv_4a4b5378-11da-46ea-87af-018478037927/kube-rbac-proxy/0.log" Jul 29 15:20:13.506177 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.506149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-proc\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.506301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.506193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-lib-modules\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.506301 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.506262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzxfx\" (UniqueName: \"kubernetes.io/projected/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-kube-api-access-mzxfx\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.506418 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.506301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-sys\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.506418 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.506349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-podres\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.551135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.551106 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sq7gn_2af26be2-1734-4613-b5e9-a0252bc4bdac/dns-node-resolver/0.log" Jul 29 15:20:13.607600 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-proc\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607781 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-lib-modules\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607781 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607697 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-proc\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607781 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzxfx\" (UniqueName: \"kubernetes.io/projected/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-kube-api-access-mzxfx\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607781 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-sys\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607958 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-podres\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607958 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-lib-modules\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607958 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-sys\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.607958 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.607905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-podres\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.617426 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.617397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzxfx\" (UniqueName: \"kubernetes.io/projected/dfa5b65f-9a47-4ded-859d-1a7dd154e56c-kube-api-access-mzxfx\") pod \"perf-node-gather-daemonset-pzbfp\" (UID: \"dfa5b65f-9a47-4ded-859d-1a7dd154e56c\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.692911 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.692813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:13.820683 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:13.820653 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp"] Jul 29 15:20:13.824040 ip-10-0-130-24 kubenswrapper[2578]: W0729 15:20:13.824011 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddfa5b65f_9a47_4ded_859d_1a7dd154e56c.slice/crio-4f9b30c9b69d836fe8f3d3ee3389c41fd3cdbddee39e456df14a3ff162516b64 WatchSource:0}: Error finding container 4f9b30c9b69d836fe8f3d3ee3389c41fd3cdbddee39e456df14a3ff162516b64: Status 404 returned error can't find the container with id 4f9b30c9b69d836fe8f3d3ee3389c41fd3cdbddee39e456df14a3ff162516b64 Jul 29 15:20:14.120978 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:14.120938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5f5jh_270e426a-fe2a-414a-8d2b-e2db7bc7f0ec/node-ca/0.log" Jul 29 15:20:14.232540 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:14.232504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" event={"ID":"dfa5b65f-9a47-4ded-859d-1a7dd154e56c","Type":"ContainerStarted","Data":"18e926adbd51afcfdbad52bf05b068def6edfab2c86bd61d2e8eae4785f0ce51"} Jul 29 15:20:14.232726 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:14.232562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" event={"ID":"dfa5b65f-9a47-4ded-859d-1a7dd154e56c","Type":"ContainerStarted","Data":"4f9b30c9b69d836fe8f3d3ee3389c41fd3cdbddee39e456df14a3ff162516b64"} Jul 29 15:20:14.232726 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:14.232624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:14.251472 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:14.251422 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" podStartSLOduration=1.2514056519999999 podStartE2EDuration="1.251405652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:20:14.249800126 +0000 UTC m=+1109.896883156" watchObservedRunningTime="2026-07-29 15:20:14.251405652 +0000 UTC m=+1109.898488684" Jul 29 15:20:15.281994 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:15.281967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4gsn6_7f3418b8-919c-4c67-aa19-ccd3b1ff1062/serve-healthcheck-canary/0.log" Jul 29 15:20:15.787091 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:15.787064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8wbs_faa9b566-9bcb-4897-9692-bf65abf341cb/kube-rbac-proxy/0.log" Jul 29 15:20:15.808683 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:15.808654 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8wbs_faa9b566-9bcb-4897-9692-bf65abf341cb/exporter/0.log" Jul 29 15:20:15.832294 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:15.832267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8wbs_faa9b566-9bcb-4897-9692-bf65abf341cb/extractor/0.log" Jul 29 15:20:18.232444 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:18.232410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-rrd7r_b5489543-016d-4f01-97c2-9f7b8b1be092/manager/6.log" Jul 29 15:20:18.232444 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:18.232428 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-rrd7r_b5489543-016d-4f01-97c2-9f7b8b1be092/manager/6.log" Jul 29 15:20:20.245757 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:20.245732 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-pzbfp" Jul 29 15:20:20.936517 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:20.936481 2578 scope.go:117] "RemoveContainer" containerID="483e6d0215db4be90f06502438620c55ac11a4cc73076872192a73b2d5124218" Jul 29 15:20:20.936741 ip-10-0-130-24 kubenswrapper[2578]: E0729 15:20:20.936714 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-rrd7r_kserve(b5489543-016d-4f01-97c2-9f7b8b1be092)\"" pod="kserve/llmisvc-controller-manager-654c557856-rrd7r" podUID="b5489543-016d-4f01-97c2-9f7b8b1be092" Jul 29 15:20:22.250271 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:22.250234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-jqxdk_13420494-d7f6-447b-97ac-1228d57956ae/migrator/0.log" Jul 29 15:20:22.273270 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:22.273239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-jqxdk_13420494-d7f6-447b-97ac-1228d57956ae/graceful-termination/0.log" Jul 29 15:20:23.644632 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.644579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7j5fl_be38e6a0-12dc-4fcc-ad39-d1033bd0bce0/kube-multus/0.log" Jul 29 15:20:23.839813 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.839787 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/kube-multus-additional-cni-plugins/0.log" Jul 29 15:20:23.862377 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.862347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/egress-router-binary-copy/0.log" Jul 29 15:20:23.886543 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.886509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/cni-plugins/0.log" Jul 29 15:20:23.909596 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.909524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/bond-cni-plugin/0.log" Jul 29 15:20:23.931135 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.931101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/routeoverride-cni/0.log" Jul 29 15:20:23.951621 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.951576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/whereabouts-cni-bincopy/0.log" Jul 29 15:20:23.973779 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:23.973744 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p8x22_95f314eb-905b-4b6f-807e-3146c973e992/whereabouts-cni/0.log" Jul 29 15:20:24.309269 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:24.309231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xd8zr_cd920715-09e0-4206-aac2-0e412a5ec171/network-metrics-daemon/0.log" Jul 29 15:20:24.331552 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:24.331521 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xd8zr_cd920715-09e0-4206-aac2-0e412a5ec171/kube-rbac-proxy/0.log" Jul 29 15:20:25.499925 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.499896 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/ovn-controller/0.log" Jul 29 15:20:25.521026 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.521003 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/ovn-acl-logging/0.log" Jul 29 15:20:25.547532 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.547510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/kube-rbac-proxy-node/0.log" Jul 29 15:20:25.575158 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.575132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 15:20:25.599994 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.599972 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/northd/0.log" Jul 29 15:20:25.622904 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.622873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/nbdb/0.log" Jul 29 15:20:25.649064 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.649038 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/sbdb/0.log" Jul 29 15:20:25.701509 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:25.701481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z84l6_07a172b9-6c88-4b01-b8cd-e32c6524205d/ovnkube-controller/0.log" Jul 29 15:20:26.712065 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:26.712033 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-6b68s_b864e6d2-8a80-4e05-a909-6a8ee943dad5/check-endpoints/0.log" Jul 29 15:20:26.775037 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:26.775006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-svmx6_a3f9e0c6-8eae-4c1e-81e2-2f3acfa8df6f/network-check-target-container/0.log" Jul 29 15:20:27.774416 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:27.774381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-z8xpr_9a9dbc14-60c8-4698-a2e2-575a4d02f1ee/iptables-alerter/0.log" Jul 29 15:20:28.438556 ip-10-0-130-24 kubenswrapper[2578]: I0729 15:20:28.438518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wgktn_3a6d9f2f-d914-406b-849e-022b4387f49a/tuned/0.log"