Jul 28 13:43:03.507111 ip-10-0-130-220 systemd[1]: Starting Kubernetes Kubelet... Jul 28 13:43:03.866394 ip-10-0-130-220 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:43:03.866394 ip-10-0-130-220 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 13:43:03.866394 ip-10-0-130-220 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:43:03.866394 ip-10-0-130-220 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 13:43:03.866394 ip-10-0-130-220 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:43:03.867314 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.867236 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 13:43:03.874574 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874553 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:43:03.874574 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874572 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:43:03.874574 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874577 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:43:03.874574 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874580 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874584 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874587 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874590 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874594 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874597 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874599 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874602 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874605 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874607 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874610 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874613 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874615 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874618 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874620 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874623 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874626 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874628 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874631 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874633 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:43:03.874741 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874636 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874639 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874642 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874644 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874653 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874656 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874658 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874661 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874663 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874666 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874668 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874670 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874673 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874676 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874679 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874682 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874684 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874686 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874689 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874691 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:43:03.875235 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874694 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874696 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874699 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874701 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874704 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874706 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874709 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874711 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874713 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874716 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874719 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874722 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874726 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874729 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874732 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874735 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874737 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874740 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874742 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:43:03.875722 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874745 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874748 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874751 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874754 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874757 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874760 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874762 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874766 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874769 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874771 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874787 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874791 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874795 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874797 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874800 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874802 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874805 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874808 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874810 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874813 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:43:03.876231 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874815 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874818 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874821 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874825 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874827 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874830 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874833 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874836 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874838 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874841 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874844 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874846 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874849 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874851 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874854 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874857 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.874859 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875532 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875539 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875543 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:43:03.876726 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875547 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875550 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875553 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875555 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875559 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875562 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875564 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875567 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875569 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875572 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875574 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875577 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875579 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875582 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875585 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875588 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875590 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875593 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875596 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875598 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:43:03.877226 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875601 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875603 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875606 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875608 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875610 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875613 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875615 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875618 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875621 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875623 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875626 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875629 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875632 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875634 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875636 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875639 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875641 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875644 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875646 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875649 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:43:03.877732 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875651 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875656 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875659 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875662 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875665 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875668 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875670 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875673 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875676 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875678 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875681 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875683 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875686 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875688 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875691 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875693 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875696 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875698 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875700 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875703 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:43:03.878237 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875706 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875708 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875711 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875714 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875717 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875719 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875722 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875725 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875728 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875730 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875733 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875736 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875738 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875741 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875743 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875746 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875748 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875751 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875753 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875756 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:43:03.878733 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875758 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875761 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875764 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875768 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875771 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875789 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875792 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875795 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875798 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875800 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875803 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875806 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875809 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875811 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875814 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.875818 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876170 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876174 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876177 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:43:03.879233 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876180 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876182 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876185 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876187 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876191 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876193 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876196 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876198 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876200 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876203 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876206 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876208 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876211 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876213 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876218 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876222 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876225 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876228 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876231 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:43:03.879703 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876234 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876237 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876240 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876242 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876245 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876248 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876251 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876254 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876256 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876259 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876262 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876265 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876267 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876270 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876273 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876275 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876278 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876280 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876283 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876285 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:43:03.880181 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876288 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876292 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876295 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876298 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876301 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876304 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876306 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876309 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876312 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876314 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876317 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876319 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876322 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876325 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876328 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876331 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876333 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876336 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876338 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:43:03.880668 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876340 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876343 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876346 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876348 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876351 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876353 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876356 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876358 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876360 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876363 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876365 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876368 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876370 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876373 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876375 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876377 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876380 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876382 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876385 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876388 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:43:03.881177 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876390 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876393 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876395 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876399 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876403 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876405 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876408 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876411 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876413 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876416 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876419 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876421 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876424 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876426 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876430 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876432 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876435 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.876437 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876503 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876510 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876517 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 13:43:03.881660 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876523 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876528 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876533 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876539 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876545 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876549 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876551 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876555 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876558 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876561 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876564 2566 flags.go:64] FLAG: --cgroup-root="" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876567 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876569 2566 flags.go:64] FLAG: --client-ca-file="" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876573 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876576 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876580 2566 flags.go:64] FLAG: --cluster-domain="" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876583 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876586 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876589 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876592 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876596 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876599 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876602 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 13:43:03.882181 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876606 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876609 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876612 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876615 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876618 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876621 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876625 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876628 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876631 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876633 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876637 2566 flags.go:64] FLAG: --enable-server="true" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876640 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876643 2566 flags.go:64] FLAG: --event-burst="100" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876646 2566 flags.go:64] FLAG: --event-qps="50" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876649 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876652 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876655 2566 flags.go:64] FLAG: --eviction-hard="" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876658 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876661 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876664 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876667 2566 flags.go:64] FLAG: --eviction-soft="" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876670 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876673 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876676 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876679 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 13:43:03.882754 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876682 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876685 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876687 2566 flags.go:64] FLAG: --feature-gates="" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876691 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876694 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876696 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876709 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876712 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876715 2566 flags.go:64] FLAG: --help="false" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876719 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-220.ec2.internal" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876724 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876729 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876733 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876739 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876742 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876745 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876748 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876751 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876753 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876756 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876759 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876762 2566 flags.go:64] FLAG: --kube-reserved="" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876765 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876767 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 13:43:03.883406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876770 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876784 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876787 2566 flags.go:64] FLAG: --lock-file="" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876789 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876792 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876799 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876805 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876809 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876812 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876815 2566 flags.go:64] FLAG: --logging-format="text" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876818 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876821 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876824 2566 flags.go:64] FLAG: --manifest-url="" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876827 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876831 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876834 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876838 2566 flags.go:64] FLAG: --max-pods="110" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876841 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876844 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876846 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876849 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876852 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876855 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876858 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876865 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 13:43:03.884021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876868 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876871 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876874 2566 flags.go:64] FLAG: --pod-cidr="" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876877 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876883 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876885 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876888 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876891 2566 flags.go:64] FLAG: --port="10250" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876894 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876897 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0505f3296521a9b0e" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876900 2566 flags.go:64] FLAG: --qos-reserved="" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876903 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876906 2566 flags.go:64] FLAG: --register-node="true" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876910 2566 flags.go:64] FLAG: --register-with-taints="" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876914 2566 flags.go:64] FLAG: --registry-burst="10" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876917 2566 flags.go:64] FLAG: --registry-qps="5" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876920 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876923 2566 flags.go:64] FLAG: --reserved-memory="" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876927 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876930 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876932 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876935 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876938 2566 flags.go:64] FLAG: --runonce="false" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876941 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876945 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 13:43:03.884683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876948 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876951 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876954 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876957 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876959 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876962 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876965 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876968 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876971 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876974 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876976 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876979 2566 flags.go:64] FLAG: --system-cgroups="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876982 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876987 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876990 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876993 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.876997 2566 flags.go:64] FLAG: --tls-min-version="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877000 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877003 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877005 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877010 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877013 2566 flags.go:64] FLAG: --v="2" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877016 2566 flags.go:64] FLAG: --version="false" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877021 2566 flags.go:64] FLAG: --vmodule="" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877024 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 13:43:03.885329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877028 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877134 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877138 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877141 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877144 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877146 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877152 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877154 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877157 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877159 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877162 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877164 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877168 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877170 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877173 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877175 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877178 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877180 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877183 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877185 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:43:03.885955 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877188 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877191 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877193 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877196 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877198 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877201 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877204 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877207 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877210 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877213 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877216 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877219 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877222 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877224 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877227 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877230 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877239 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877243 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877247 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877250 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:43:03.886451 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877253 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877255 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877258 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877260 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877263 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877265 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877268 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877271 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877273 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877276 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877278 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877281 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877283 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877286 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877290 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877294 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877298 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877301 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877304 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:43:03.886971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877309 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877312 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877315 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877317 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877320 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877323 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877326 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877329 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877332 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877335 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877337 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877341 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877344 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877346 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877350 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877353 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877356 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877359 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877361 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:43:03.887449 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877364 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877366 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877369 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877371 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877374 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877376 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877379 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877381 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877384 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877387 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877389 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877392 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877394 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877399 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877401 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877404 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877407 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877409 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877412 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877415 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:43:03.887997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877417 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.877420 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.877425 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.884365 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.884381 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.885186 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.885198 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885268 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885274 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885278 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885281 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885284 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885287 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885289 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885292 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:43:03.888525 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885295 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885298 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885300 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885303 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885306 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885308 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885311 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885313 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885316 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885319 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885321 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885324 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885327 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885329 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885332 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885335 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885338 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885341 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885343 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:43:03.888937 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885348 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885351 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885361 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885364 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885367 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885370 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885372 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885375 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885378 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885380 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885382 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885385 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885388 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885390 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885393 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885395 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885398 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885400 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885403 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885405 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:43:03.889410 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885408 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885410 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885413 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885415 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885418 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885421 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885423 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885426 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885429 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885433 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885436 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885438 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885441 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885444 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885447 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885455 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885458 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885461 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885463 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:43:03.889971 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885466 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885468 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885471 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885473 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885476 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885478 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885481 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885483 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885486 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885488 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885491 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885493 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885497 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885501 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885503 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885506 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885509 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885511 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885514 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:43:03.890472 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885516 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885519 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885521 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885524 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885526 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885529 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885531 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885534 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885537 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885540 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885551 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885554 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885556 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885559 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.885564 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:43:03.891282 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885709 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885714 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885717 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885720 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885723 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885725 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885728 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885730 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885733 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885735 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885738 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885742 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885747 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885749 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885752 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885755 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885757 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885760 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885762 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885765 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:43:03.891916 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885767 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885770 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885772 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885788 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885792 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885795 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885798 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885801 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885810 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885813 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885816 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885818 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885821 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885823 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885826 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885828 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885831 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885833 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885836 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:43:03.892467 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885838 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885841 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885843 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885845 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885848 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885850 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885853 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885855 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885857 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885860 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885862 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885865 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885867 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885869 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885873 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885877 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885879 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885882 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885884 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885887 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:43:03.893166 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885890 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885893 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885902 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885904 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885907 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885909 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885912 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885914 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885922 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885925 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885927 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885930 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885933 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885935 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885937 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885940 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885942 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885945 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885947 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885950 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:43:03.893830 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885952 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885954 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885957 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885960 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885962 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885965 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885967 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885970 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885973 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885977 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885980 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885983 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885986 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885989 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.885991 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.886000 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.886003 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.886005 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.886007 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:43:03.894327 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:03.886010 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.886015 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.886129 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.888243 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.889708 2566 server.go:1019] "Starting client certificate rotation" Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.889837 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.890508 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:43:03.894842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.892056 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:43:03.897684 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.897659 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:43:03.910076 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.910058 2566 log.go:25] "Validated CRI v1 runtime API" Jul 28 13:43:03.912244 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.912230 2566 log.go:25] "Validated CRI v1 image API" Jul 28 13:43:03.913658 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.913644 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 13:43:03.915907 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.915886 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cbea8999-df1d-40a1-aba6-b3a35cb2b6fe:/dev/nvme0n1p3 cd96f452-088b-482f-821f-b560a34f9de6:/dev/nvme0n1p4] Jul 28 13:43:03.915985 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.915905 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 13:43:03.916823 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.916803 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:43:03.921757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.921644 2566 manager.go:216] Machine: {Timestamp:2026-07-28 13:43:03.919600299 +0000 UTC m=+0.304344089 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100163 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21e480af02bbabcabab7bdd77c5350 SystemUUID:ec21e480-af02-bbab-caba-b7bdd77c5350 BootID:90faaba1-eb71-4001-b629-c7a54d2d9a47 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:56:95:48:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:56:95:48:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:4b:1e:c0:7b:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 13:43:03.921757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.921750 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 13:43:03.921915 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.921863 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 13:43:03.924757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.924731 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 13:43:03.924899 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.924759 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 13:43:03.925513 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.925503 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 13:43:03.925549 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.925516 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 13:43:03.925549 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.925522 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:43:03.926017 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.926007 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:43:03.927649 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.927640 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 13:43:03.931592 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931581 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:43:03.931711 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931701 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 13:43:03.931748 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931730 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 28 13:43:03.931748 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931739 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 13:43:03.931838 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931753 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 13:43:03.931838 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931762 2566 kubelet.go:398] "Adding apiserver pod source" Jul 28 13:43:03.931838 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.931770 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 13:43:03.932098 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.932086 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:43:03.932132 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.932107 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:43:03.934179 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.934160 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 13:43:03.935936 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.935919 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 13:43:03.935995 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.935954 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 13:43:03.936638 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936620 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 13:43:03.936672 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936647 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 13:43:03.936672 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936660 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 13:43:03.936722 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936672 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 13:43:03.936722 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936689 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 13:43:03.936722 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936699 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 13:43:03.936722 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936714 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 13:43:03.936842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936725 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 13:43:03.936842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936747 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 13:43:03.936842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936759 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 13:43:03.936842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936804 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 13:43:03.936842 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.936817 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 13:43:03.937432 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.937422 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 13:43:03.937432 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.937432 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 13:43:03.940572 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.940555 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-txf9w" Jul 28 13:43:03.940815 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.940796 2566 server.go:1268] "Started kubelet" Jul 28 13:43:03.940892 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.940822 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 13:43:03.940952 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.940826 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 13:43:03.940999 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.940949 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 13:43:03.944366 ip-10-0-130-220 systemd[1]: Started Kubernetes Kubelet. Jul 28 13:43:03.944928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.944473 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 13:43:03.945158 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:03.944991 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 13:43:03.945158 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.945005 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 13:43:03.945267 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:03.945199 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 13:43:03.946254 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.946232 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-txf9w" Jul 28 13:43:03.946341 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:03.946296 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 13:43:03.946535 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.946521 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 28 13:43:03.954569 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:03.953873 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-220.ec2.internal.18c677f2166583d1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-220.ec2.internal,UID:ip-10-0-130-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-220.ec2.internal,},FirstTimestamp:2026-07-28 13:43:03.940522961 +0000 UTC m=+0.325266751,LastTimestamp:2026-07-28 13:43:03.940522961 +0000 UTC m=+0.325266751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-220.ec2.internal,}" Jul 28 13:43:03.956158 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956138 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 13:43:03.956158 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956145 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 13:43:03.956322 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:03.956308 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:03.956834 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956811 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 13:43:03.956834 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956812 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 13:43:03.956953 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956840 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 13:43:03.956953 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956921 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 28 13:43:03.956953 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.956931 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 28 13:43:03.957117 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957097 2566 factory.go:55] Registering systemd factory Jul 28 13:43:03.957167 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957120 2566 factory.go:223] Registration of the systemd container factory successfully Jul 28 13:43:03.957353 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957337 2566 factory.go:153] Registering CRI-O factory Jul 28 13:43:03.957353 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957352 2566 factory.go:223] Registration of the crio container factory successfully Jul 28 13:43:03.957476 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957393 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 13:43:03.957476 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957413 2566 factory.go:103] Registering Raw factory Jul 28 13:43:03.957476 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957426 2566 manager.go:1196] Started watching for new ooms in manager Jul 28 13:43:03.957840 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.957826 2566 manager.go:349] Starting recovery of all containers Jul 28 13:43:03.965743 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.965719 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:43:03.968033 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.967951 2566 manager.go:354] Recovery completed Jul 28 13:43:03.968770 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:03.968752 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-220.ec2.internal\" not found" node="ip-10-0-130-220.ec2.internal" Jul 28 13:43:03.973961 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.973931 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:03.976005 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.975983 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:03.976091 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.976010 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:03.976091 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.976021 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:03.976529 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.976514 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 13:43:03.976529 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.976528 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 13:43:03.976642 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.976544 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:43:03.976642 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.976543 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:03.977434 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.977418 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:03.977507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.977448 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:03.977507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.977463 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:03.978496 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.978485 2566 policy_none.go:49] "None policy: Start" Jul 28 13:43:03.978541 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.978500 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 13:43:03.978541 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.978510 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 13:43:03.980239 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:03.980228 2566 policy_none.go:47] "Start" Jul 28 13:43:04.020368 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020351 2566 manager.go:337] "Starting Device Plugin manager" Jul 28 13:43:04.020443 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:04.020376 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 13:43:04.020443 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020386 2566 server.go:87] "Starting device plugin registration server" Jul 28 13:43:04.020607 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020594 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 13:43:04.020651 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020610 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 13:43:04.020721 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020704 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 13:43:04.020811 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020796 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 13:43:04.020863 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.020813 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 13:43:04.021218 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:04.021196 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 13:43:04.021304 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:04.021251 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:04.121018 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.120965 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:04.123019 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.121889 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:04.123019 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.121916 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:04.123019 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.121925 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:04.123019 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.121952 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-220.ec2.internal" Jul 28 13:43:04.130264 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.130249 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-220.ec2.internal" Jul 28 13:43:04.130311 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:04.130270 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-220.ec2.internal\": node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:04.146281 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.146254 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 13:43:04.147453 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.147436 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 13:43:04.147507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.147483 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 13:43:04.147507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.147506 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 13:43:04.147603 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:04.147543 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 13:43:04.148532 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:04.148510 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:04.149934 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:04.149919 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:43:05.292007 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.291853 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal"] Jul 28 13:43:05.292099 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.292053 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.292099 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.292058 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:05.293550 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.293535 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:05.293622 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.293562 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:05.293622 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.293573 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:05.295787 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.295776 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:05.295911 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.295895 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.295951 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.295927 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:05.296494 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.296483 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:05.296563 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.296510 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:05.296563 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.296522 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:05.297256 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.297240 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:05.297313 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.297265 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:05.297313 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.297275 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:05.299424 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.299410 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.299471 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.299436 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:43:05.300140 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.300121 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:43:05.300211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.300148 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:43:05.300211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.300163 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:43:05.301761 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.301743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e00b2cc629bdf6b35c44037fc78427b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal\" (UID: \"e00b2cc629bdf6b35c44037fc78427b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.301831 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.301775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e00b2cc629bdf6b35c44037fc78427b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal\" (UID: \"e00b2cc629bdf6b35c44037fc78427b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.301831 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.301803 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e80f3fd793768cfa4cf0588123d22c76-config\") pod \"kube-apiserver-proxy-ip-10-0-130-220.ec2.internal\" (UID: \"e80f3fd793768cfa4cf0588123d22c76\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.320774 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.320754 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-220.ec2.internal\" not found" node="ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.324942 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.324928 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-220.ec2.internal\" not found" node="ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.392767 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.392750 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.402091 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.402067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e00b2cc629bdf6b35c44037fc78427b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal\" (UID: \"e00b2cc629bdf6b35c44037fc78427b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.402153 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.402096 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e00b2cc629bdf6b35c44037fc78427b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal\" (UID: \"e00b2cc629bdf6b35c44037fc78427b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.402208 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.402144 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e00b2cc629bdf6b35c44037fc78427b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal\" (UID: \"e00b2cc629bdf6b35c44037fc78427b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.402208 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.402179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e80f3fd793768cfa4cf0588123d22c76-config\") pod \"kube-apiserver-proxy-ip-10-0-130-220.ec2.internal\" (UID: \"e80f3fd793768cfa4cf0588123d22c76\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.402208 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.402189 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e00b2cc629bdf6b35c44037fc78427b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal\" (UID: \"e00b2cc629bdf6b35c44037fc78427b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.402326 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.402214 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e80f3fd793768cfa4cf0588123d22c76-config\") pod \"kube-apiserver-proxy-ip-10-0-130-220.ec2.internal\" (UID: \"e80f3fd793768cfa4cf0588123d22c76\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.493587 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.493508 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.593993 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.593963 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.623483 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.623466 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.629385 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.629144 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" Jul 28 13:43:05.694993 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.694954 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.795535 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.795466 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.895961 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.895930 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:05.932432 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.932411 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 13:43:05.932801 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.932548 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:43:05.932801 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.932574 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:43:05.994974 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.994938 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 13:38:04 +0000 UTC" deadline="2028-01-12 19:42:34.094966335 +0000 UTC" Jul 28 13:43:05.994974 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:05.994972 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12797h59m28.099997682s" Jul 28 13:43:05.996036 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:05.996021 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:06.097013 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:06.096959 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-220.ec2.internal\" not found" Jul 28 13:43:06.157633 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.157615 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:43:06.200391 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.200360 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" Jul 28 13:43:06.213941 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.213923 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:43:06.215370 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.215354 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" Jul 28 13:43:06.225051 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.225032 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:43:06.248435 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.248418 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:43:06.278856 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:06.278832 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80f3fd793768cfa4cf0588123d22c76.slice/crio-51ec03c8a4d40419e93bddb65ab4baf892248771964adca69385126d36e6a34d WatchSource:0}: Error finding container 51ec03c8a4d40419e93bddb65ab4baf892248771964adca69385126d36e6a34d: Status 404 returned error can't find the container with id 51ec03c8a4d40419e93bddb65ab4baf892248771964adca69385126d36e6a34d Jul 28 13:43:06.279242 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:06.279202 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00b2cc629bdf6b35c44037fc78427b4.slice/crio-83003faa0d0e87d6f9b7d0f8d8ae049ad357c09f41d26f2f1ca70b03500a409b WatchSource:0}: Error finding container 83003faa0d0e87d6f9b7d0f8d8ae049ad357c09f41d26f2f1ca70b03500a409b: Status 404 returned error can't find the container with id 83003faa0d0e87d6f9b7d0f8d8ae049ad357c09f41d26f2f1ca70b03500a409b Jul 28 13:43:06.283529 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.283512 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:43:06.976097 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.976043 2566 apiserver.go:52] "Watching apiserver" Jul 28 13:43:06.984184 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.984152 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 13:43:06.986809 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.986772 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-gwdhd","openshift-multus/network-metrics-daemon-sp6g4","kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal","openshift-dns/node-resolver-z6qmq","openshift-multus/multus-additional-cni-plugins-j48v7","openshift-network-diagnostics/network-check-target-df58h","openshift-network-operator/iptables-alerter-pnh9c","openshift-ovn-kubernetes/ovnkube-node-nx7bb","kube-system/global-pull-secret-syncer-cfp42","kube-system/konnectivity-agent-ht7bq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb","openshift-cluster-node-tuning-operator/tuned-zpwhh","openshift-image-registry/node-ca-b4rfl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal"] Jul 28 13:43:06.989301 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.989279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:06.993042 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.991609 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:43:06.993042 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.991981 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nf77m\"" Jul 28 13:43:06.993042 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.992158 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 13:43:06.993042 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.992474 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 13:43:06.993042 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.992711 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:06.994591 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.994554 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 13:43:06.994775 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.994755 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 13:43:06.994853 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.994780 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-86vks\"" Jul 28 13:43:06.994988 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.994970 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 13:43:06.996349 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.995327 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:06.997887 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.997387 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 13:43:06.997887 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.997758 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9xmlw\"" Jul 28 13:43:06.998055 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.997937 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 13:43:06.998135 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.998067 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 13:43:06.998135 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.998130 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 13:43:06.998258 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.998251 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 13:43:07.000796 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:06.999952 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.000796 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.000190 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 13:43:07.001147 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.001017 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 13:43:07.002604 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.002584 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 13:43:07.002692 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.002619 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 13:43:07.002772 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.002754 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-svjpr\"" Jul 28 13:43:07.004950 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.004883 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.007052 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007030 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007168 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cwhzq\"" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007361 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007545 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.007706 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007739 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 13:43:07.008109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.007916 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 13:43:07.010436 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.010411 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.010698 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.010593 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:07.010973 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.010949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-ovn\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011049 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.010993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-cni-bin\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011049 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-env-overrides\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011159 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-596bj\" (UniqueName: \"kubernetes.io/projected/03a622cd-d09c-46df-944d-f746438788d5-kube-api-access-596bj\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011159 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011093 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.011159 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26t6\" (UniqueName: \"kubernetes.io/projected/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-kube-api-access-v26t6\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.011159 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cac480a5-23cc-4692-9ed9-835ce99fd71b-serviceca\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-etc-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-os-release\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011247 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011274 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f41c1866-949d-4ad4-928d-4a553af076ec-iptables-alerter-script\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-kubelet\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03a622cd-d09c-46df-944d-f746438788d5-ovn-node-metrics-cert\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-system-cni-dir\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011374 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-systemd\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-log-socket\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnj5\" (UniqueName: \"kubernetes.io/projected/f41c1866-949d-4ad4-928d-4a553af076ec-kube-api-access-dqnj5\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cac480a5-23cc-4692-9ed9-835ce99fd71b-host\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011616 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-var-lib-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-ovnkube-script-lib\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.011785 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsn7t\" (UniqueName: \"kubernetes.io/projected/cac480a5-23cc-4692-9ed9-835ce99fd71b-kube-api-access-tsn7t\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.012219 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.011753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-systemd-units\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012470 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-node-log\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtkn\" (UniqueName: \"kubernetes.io/projected/29b4e541-65ae-4874-9d60-76bec859fbe0-kube-api-access-pbtkn\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cnibin\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012704 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f41c1866-949d-4ad4-928d-4a553af076ec-host-slash\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-run-netns\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-cni-netd\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.012783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b4e541-65ae-4874-9d60-76bec859fbe0-tmp-dir\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.013247 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-slash\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.013401 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.013416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.013465 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-ovnkube-config\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.014946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.013527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29b4e541-65ae-4874-9d60-76bec859fbe0-hosts-file\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.016595 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.016574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.018762 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.018743 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.018860 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.018817 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:07.019029 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.019013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 13:43:07.019180 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.019014 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xxnkj\"" Jul 28 13:43:07.021199 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.021179 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.023452 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.023429 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n9nbd\"" Jul 28 13:43:07.024338 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.024318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.024924 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.024908 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 13:43:07.025273 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.025039 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 13:43:07.026482 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.026442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.027547 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.027525 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 13:43:07.027672 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.027652 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 13:43:07.027885 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.027870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 13:43:07.029012 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.028994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-krmhf\"" Jul 28 13:43:07.029261 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.029243 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 13:43:07.029710 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.029688 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nqwwv\"" Jul 28 13:43:07.029990 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.029899 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:43:07.033258 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.033239 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gs7fj" Jul 28 13:43:07.040926 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.040907 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gs7fj" Jul 28 13:43:07.102120 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.102097 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 13:43:07.114302 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-lib-modules\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.114400 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114313 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghkw\" (UniqueName: \"kubernetes.io/projected/3f3f6359-b763-44bb-b068-403ce35f8083-kube-api-access-hghkw\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.114400 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.114400 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-log-socket\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.114400 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f3f6359-b763-44bb-b068-403ce35f8083-etc-tuned\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-cni-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnj5\" (UniqueName: \"kubernetes.io/projected/f41c1866-949d-4ad4-928d-4a553af076ec-kube-api-access-dqnj5\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cac480a5-23cc-4692-9ed9-835ce99fd71b-host\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-var-lib-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114532 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-ovnkube-script-lib\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-host\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.114605 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909de677-86e1-4962-90b8-ae7a5a4e875f-cni-binary-copy\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114614 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-netns\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-socket-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtkn\" (UniqueName: \"kubernetes.io/projected/29b4e541-65ae-4874-9d60-76bec859fbe0-kube-api-access-pbtkn\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114686 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cnibin\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-kubelet-config\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-registration-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-device-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-run-netns\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-cni-netd\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-modprobe-d\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.114971 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-slash\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.114983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-ovnkube-config\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-run\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-var-lib-kubelet\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-socket-dir-parent\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-k8s-cni-cncf-io\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-cni-bin\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115336 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-cni-netd\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115350 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-slash\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-596bj\" (UniqueName: \"kubernetes.io/projected/03a622cd-d09c-46df-944d-f746438788d5-kube-api-access-596bj\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115402 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-run-netns\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115462 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cac480a5-23cc-4692-9ed9-835ce99fd71b-host\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115472 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-cni-bin\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115470 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-log-socket\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-sys\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-os-release\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.115780 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115767 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cnibin\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-dbus\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-os-release\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115940 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.115976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysctl-conf\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116018 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-conf-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116058 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-var-lib-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f41c1866-949d-4ad4-928d-4a553af076ec-iptables-alerter-script\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116092 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-ovnkube-config\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-kubelet\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116130 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-hostroot\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116207 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-kubelet\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116258 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-systemd\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.116582 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-cni-bin\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116293 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-systemd\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-kubelet\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116333 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbdv\" (UniqueName: \"kubernetes.io/projected/909de677-86e1-4962-90b8-ae7a5a4e875f-kube-api-access-cpbdv\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-daemon-config\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116407 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-etc-kubernetes\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-sys-fs\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116428 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsn7t\" (UniqueName: \"kubernetes.io/projected/cac480a5-23cc-4692-9ed9-835ce99fd71b-kube-api-access-tsn7t\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-systemd-units\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116494 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-ovnkube-script-lib\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-node-log\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116540 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-systemd-units\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116539 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysctl-d\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116578 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-node-log\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-cnibin\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.117410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116641 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f41c1866-949d-4ad4-928d-4a553af076ec-iptables-alerter-script\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116647 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmt7h\" (UniqueName: \"kubernetes.io/projected/065652d1-71b1-44b0-96fa-159cdad5012e-kube-api-access-jmt7h\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f41c1866-949d-4ad4-928d-4a553af076ec-host-slash\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b4e541-65ae-4874-9d60-76bec859fbe0-tmp-dir\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/342902a2-1fcf-4b69-93d5-c3b95c60af33-agent-certs\") pod \"konnectivity-agent-ht7bq\" (UID: \"342902a2-1fcf-4b69-93d5-c3b95c60af33\") " pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3f6359-b763-44bb-b068-403ce35f8083-tmp\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116811 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-os-release\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29b4e541-65ae-4874-9d60-76bec859fbe0-hosts-file\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysconfig\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-systemd\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116893 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f41c1866-949d-4ad4-928d-4a553af076ec-host-slash\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-cni-multus\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116924 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-ovn\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-env-overrides\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-run-ovn\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.118190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116951 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29b4e541-65ae-4874-9d60-76bec859fbe0-hosts-file\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.116999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26t6\" (UniqueName: \"kubernetes.io/projected/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-kube-api-access-v26t6\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-kubernetes\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cac480a5-23cc-4692-9ed9-835ce99fd71b-serviceca\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-etc-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/342902a2-1fcf-4b69-93d5-c3b95c60af33-konnectivity-ca\") pod \"konnectivity-agent-ht7bq\" (UID: \"342902a2-1fcf-4b69-93d5-c3b95c60af33\") " pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-system-cni-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-multus-certs\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117731 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03a622cd-d09c-46df-944d-f746438788d5-ovn-node-metrics-cert\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-system-cni-dir\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbjb\" (UniqueName: \"kubernetes.io/projected/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-kube-api-access-2sbjb\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117942 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.117024 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b4e541-65ae-4874-9d60-76bec859fbe0-tmp-dir\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.118024 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03a622cd-d09c-46df-944d-f746438788d5-env-overrides\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.118739 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.118199 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.119501 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.118513 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cac480a5-23cc-4692-9ed9-835ce99fd71b-serviceca\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.119501 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.118697 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 13:43:07.119501 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.118786 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-system-cni-dir\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.119501 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.118811 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03a622cd-d09c-46df-944d-f746438788d5-etc-openvswitch\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.122781 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.122699 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03a622cd-d09c-46df-944d-f746438788d5-ovn-node-metrics-cert\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.125219 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.125169 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-596bj\" (UniqueName: \"kubernetes.io/projected/03a622cd-d09c-46df-944d-f746438788d5-kube-api-access-596bj\") pod \"ovnkube-node-nx7bb\" (UID: \"03a622cd-d09c-46df-944d-f746438788d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.125463 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.125443 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsn7t\" (UniqueName: \"kubernetes.io/projected/cac480a5-23cc-4692-9ed9-835ce99fd71b-kube-api-access-tsn7t\") pod \"node-ca-b4rfl\" (UID: \"cac480a5-23cc-4692-9ed9-835ce99fd71b\") " pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.125940 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.125921 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtkn\" (UniqueName: \"kubernetes.io/projected/29b4e541-65ae-4874-9d60-76bec859fbe0-kube-api-access-pbtkn\") pod \"node-resolver-z6qmq\" (UID: \"29b4e541-65ae-4874-9d60-76bec859fbe0\") " pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.128115 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.128091 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnj5\" (UniqueName: \"kubernetes.io/projected/f41c1866-949d-4ad4-928d-4a553af076ec-kube-api-access-dqnj5\") pod \"iptables-alerter-pnh9c\" (UID: \"f41c1866-949d-4ad4-928d-4a553af076ec\") " pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.132076 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.132057 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26t6\" (UniqueName: \"kubernetes.io/projected/3769c3b5-31ef-45e8-bebf-0bde9679ebd3-kube-api-access-v26t6\") pod \"multus-additional-cni-plugins-j48v7\" (UID: \"3769c3b5-31ef-45e8-bebf-0bde9679ebd3\") " pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.193912 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.193882 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:43:07.195690 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.195649 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" event={"ID":"e80f3fd793768cfa4cf0588123d22c76","Type":"ContainerStarted","Data":"51ec03c8a4d40419e93bddb65ab4baf892248771964adca69385126d36e6a34d"} Jul 28 13:43:07.196753 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.196733 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" event={"ID":"e00b2cc629bdf6b35c44037fc78427b4","Type":"ContainerStarted","Data":"83003faa0d0e87d6f9b7d0f8d8ae049ad357c09f41d26f2f1ca70b03500a409b"} Jul 28 13:43:07.218377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-host\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.218489 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218390 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909de677-86e1-4962-90b8-ae7a5a4e875f-cni-binary-copy\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.218489 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218413 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-netns\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.218489 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-socket-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.218489 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-kubelet-config\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-registration-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218514 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-netns\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-device-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218475 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-host\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-modprobe-d\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218590 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-kubelet-config\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-socket-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-run\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-var-lib-kubelet\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218642 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-device-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.218686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-socket-dir-parent\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-k8s-cni-cncf-io\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218705 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218738 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-sys\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218741 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-k8s-cni-cncf-io\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218746 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-run\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-dbus\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218786 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218789 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-var-lib-kubelet\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218790 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-socket-dir-parent\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218834 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-registration-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218843 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-sys\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysctl-conf\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-conf-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-hostroot\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218906 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909de677-86e1-4962-90b8-ae7a5a4e875f-cni-binary-copy\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218917 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-dbus\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.218925 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:07.219310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-cni-bin\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-kubelet\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-conf-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.218984 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:07.718964142 +0000 UTC m=+3.060259768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.218998 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-cni-bin\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbdv\" (UniqueName: \"kubernetes.io/projected/909de677-86e1-4962-90b8-ae7a5a4e875f-kube-api-access-cpbdv\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-daemon-config\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219076 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-etc-kubernetes\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219081 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysctl-conf\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-sys-fs\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219121 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-kubelet\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysctl-d\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-cnibin\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219178 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-cnibin\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219187 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-sys-fs\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmt7h\" (UniqueName: \"kubernetes.io/projected/065652d1-71b1-44b0-96fa-159cdad5012e-kube-api-access-jmt7h\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219246 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-etc-kubernetes\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.220211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219263 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysctl-d\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/342902a2-1fcf-4b69-93d5-c3b95c60af33-agent-certs\") pod \"konnectivity-agent-ht7bq\" (UID: \"342902a2-1fcf-4b69-93d5-c3b95c60af33\") " pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219291 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-hostroot\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3f6359-b763-44bb-b068-403ce35f8083-tmp\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-os-release\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysconfig\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-systemd\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-cni-multus\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219484 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-kubernetes\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/342902a2-1fcf-4b69-93d5-c3b95c60af33-konnectivity-ca\") pod \"konnectivity-agent-ht7bq\" (UID: \"342902a2-1fcf-4b69-93d5-c3b95c60af33\") " pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219551 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-sysconfig\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219009 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-modprobe-d\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-system-cni-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219603 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-daemon-config\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219622 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-os-release\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-multus-certs\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219657 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-systemd\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.221079 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219660 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-run-multus-certs\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219692 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/065652d1-71b1-44b0-96fa-159cdad5012e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbjb\" (UniqueName: \"kubernetes.io/projected/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-kube-api-access-2sbjb\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-lib-modules\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219731 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-host-var-lib-cni-multus\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hghkw\" (UniqueName: \"kubernetes.io/projected/3f3f6359-b763-44bb-b068-403ce35f8083-kube-api-access-hghkw\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219779 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-etc-kubernetes\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f3f6359-b763-44bb-b068-403ce35f8083-etc-tuned\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-cni-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219905 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f3f6359-b763-44bb-b068-403ce35f8083-lib-modules\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219912 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-multus-cni-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.219996 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909de677-86e1-4962-90b8-ae7a5a4e875f-system-cni-dir\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.220244 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.220312 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:07.720295394 +0000 UTC m=+3.061591023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:07.222034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.220350 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/342902a2-1fcf-4b69-93d5-c3b95c60af33-konnectivity-ca\") pod \"konnectivity-agent-ht7bq\" (UID: \"342902a2-1fcf-4b69-93d5-c3b95c60af33\") " pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.222803 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.222380 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3f6359-b763-44bb-b068-403ce35f8083-tmp\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.222803 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.222512 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/342902a2-1fcf-4b69-93d5-c3b95c60af33-agent-certs\") pod \"konnectivity-agent-ht7bq\" (UID: \"342902a2-1fcf-4b69-93d5-c3b95c60af33\") " pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.223700 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.223680 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f3f6359-b763-44bb-b068-403ce35f8083-etc-tuned\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.226821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.226773 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:07.226821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.226796 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:07.226821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.226809 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:07.227010 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.226863 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:07.726848099 +0000 UTC m=+3.068143710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:07.227558 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.227518 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbdv\" (UniqueName: \"kubernetes.io/projected/909de677-86e1-4962-90b8-ae7a5a4e875f-kube-api-access-cpbdv\") pod \"multus-gwdhd\" (UID: \"909de677-86e1-4962-90b8-ae7a5a4e875f\") " pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.229169 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.229150 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghkw\" (UniqueName: \"kubernetes.io/projected/3f3f6359-b763-44bb-b068-403ce35f8083-kube-api-access-hghkw\") pod \"tuned-zpwhh\" (UID: \"3f3f6359-b763-44bb-b068-403ce35f8083\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.229831 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.229785 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmt7h\" (UniqueName: \"kubernetes.io/projected/065652d1-71b1-44b0-96fa-159cdad5012e-kube-api-access-jmt7h\") pod \"aws-ebs-csi-driver-node-t8vsb\" (UID: \"065652d1-71b1-44b0-96fa-159cdad5012e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.230825 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.230804 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbjb\" (UniqueName: \"kubernetes.io/projected/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-kube-api-access-2sbjb\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.286963 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.286935 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:43:07.303718 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.303698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pnh9c" Jul 28 13:43:07.318463 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.318440 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b4rfl" Jul 28 13:43:07.330720 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.330700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:07.336294 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.336274 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z6qmq" Jul 28 13:43:07.344877 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.344857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j48v7" Jul 28 13:43:07.352377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.352355 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwdhd" Jul 28 13:43:07.360049 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.360032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:07.368536 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.368518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" Jul 28 13:43:07.374016 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.374000 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" Jul 28 13:43:07.723606 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.723520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:07.723606 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.723585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:07.723821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.723681 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:07.723821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.723685 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:07.723821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.723750 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:08.723729442 +0000 UTC m=+4.065025069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:07.723821 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.723791 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:08.723771393 +0000 UTC m=+4.065067021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:07.824610 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:07.824580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:07.824767 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.824748 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:07.824829 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.824774 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:07.824829 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.824783 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:07.824907 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:07.824834 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:08.824819202 +0000 UTC m=+4.166114815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:08.043959 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.043884 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:38:07 +0000 UTC" deadline="2028-03-04 22:05:11.177214709 +0000 UTC" Jul 28 13:43:08.043959 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.043914 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14048h22m3.133305213s" Jul 28 13:43:08.191594 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.191566 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:08.191732 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.191673 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:08.191773 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.191725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:08.191834 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.191813 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:08.220825 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.220750 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3769c3b5_31ef_45e8_bebf_0bde9679ebd3.slice/crio-7e99b6ea3f576028a3b7009f2f7a6ab4e3bad673e6b32bada9094413e19a9d39 WatchSource:0}: Error finding container 7e99b6ea3f576028a3b7009f2f7a6ab4e3bad673e6b32bada9094413e19a9d39: Status 404 returned error can't find the container with id 7e99b6ea3f576028a3b7009f2f7a6ab4e3bad673e6b32bada9094413e19a9d39 Jul 28 13:43:08.221928 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.221902 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a622cd_d09c_46df_944d_f746438788d5.slice/crio-663b6d05b45c014682e498bb03b3716fc3cf1d82fdb730745b70b5ada29f66c9 WatchSource:0}: Error finding container 663b6d05b45c014682e498bb03b3716fc3cf1d82fdb730745b70b5ada29f66c9: Status 404 returned error can't find the container with id 663b6d05b45c014682e498bb03b3716fc3cf1d82fdb730745b70b5ada29f66c9 Jul 28 13:43:08.243595 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.243571 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac480a5_23cc_4692_9ed9_835ce99fd71b.slice/crio-883cc40b174eb184282b904fcb36c0cb60e92c3967afe6a05e6498758ac476a8 WatchSource:0}: Error finding container 883cc40b174eb184282b904fcb36c0cb60e92c3967afe6a05e6498758ac476a8: Status 404 returned error can't find the container with id 883cc40b174eb184282b904fcb36c0cb60e92c3967afe6a05e6498758ac476a8 Jul 28 13:43:08.244354 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.244328 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3f6359_b763_44bb_b068_403ce35f8083.slice/crio-f2266bd4f79e0ea7caa496058f570e1747a4d335824b0f5f746c186befa7c951 WatchSource:0}: Error finding container f2266bd4f79e0ea7caa496058f570e1747a4d335824b0f5f746c186befa7c951: Status 404 returned error can't find the container with id f2266bd4f79e0ea7caa496058f570e1747a4d335824b0f5f746c186befa7c951 Jul 28 13:43:08.245104 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.245082 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065652d1_71b1_44b0_96fa_159cdad5012e.slice/crio-5fed857933934d2d93f633c1a7949041b4aa5a220b474953b9022b755c49491d WatchSource:0}: Error finding container 5fed857933934d2d93f633c1a7949041b4aa5a220b474953b9022b755c49491d: Status 404 returned error can't find the container with id 5fed857933934d2d93f633c1a7949041b4aa5a220b474953b9022b755c49491d Jul 28 13:43:08.246042 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.245987 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909de677_86e1_4962_90b8_ae7a5a4e875f.slice/crio-5295e6c7d86fc86388f7c607486681bfb48fc279538a87975909d9d658eb641e WatchSource:0}: Error finding container 5295e6c7d86fc86388f7c607486681bfb48fc279538a87975909d9d658eb641e: Status 404 returned error can't find the container with id 5295e6c7d86fc86388f7c607486681bfb48fc279538a87975909d9d658eb641e Jul 28 13:43:08.247764 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.247678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342902a2_1fcf_4b69_93d5_c3b95c60af33.slice/crio-217bf73351b5239bbc62e45eca9cddb0fbd66a15f1ab50f0035e525b86371d62 WatchSource:0}: Error finding container 217bf73351b5239bbc62e45eca9cddb0fbd66a15f1ab50f0035e525b86371d62: Status 404 returned error can't find the container with id 217bf73351b5239bbc62e45eca9cddb0fbd66a15f1ab50f0035e525b86371d62 Jul 28 13:43:08.249678 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.249577 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41c1866_949d_4ad4_928d_4a553af076ec.slice/crio-081aee31468fa520c879e4805deccebf9f1ccd006104cc622bd3a06936d38bd2 WatchSource:0}: Error finding container 081aee31468fa520c879e4805deccebf9f1ccd006104cc622bd3a06936d38bd2: Status 404 returned error can't find the container with id 081aee31468fa520c879e4805deccebf9f1ccd006104cc622bd3a06936d38bd2 Jul 28 13:43:08.250120 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:08.250094 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b4e541_65ae_4874_9d60_76bec859fbe0.slice/crio-b19b1b3d81be6ab40a8f0dcf6d3f836247c3b668e77a2937f26381d06b2fe0c8 WatchSource:0}: Error finding container b19b1b3d81be6ab40a8f0dcf6d3f836247c3b668e77a2937f26381d06b2fe0c8: Status 404 returned error can't find the container with id b19b1b3d81be6ab40a8f0dcf6d3f836247c3b668e77a2937f26381d06b2fe0c8 Jul 28 13:43:08.731751 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.731440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:08.731751 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.731743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:08.731953 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.731882 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:08.731953 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.731942 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:10.731923098 +0000 UTC m=+6.073218714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:08.732361 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.732341 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:08.732439 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.732396 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:10.732382011 +0000 UTC m=+6.073677628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:08.832969 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:08.832932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:08.833142 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.833099 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:08.833142 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.833116 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:08.833142 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.833128 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:08.833345 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:08.833181 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:10.833165192 +0000 UTC m=+6.174460805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:09.045073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.045011 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:38:07 +0000 UTC" deadline="2028-01-15 20:36:20.509358181 +0000 UTC" Jul 28 13:43:09.045073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.045071 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12870h53m11.464291566s" Jul 28 13:43:09.193676 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.193645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:09.193889 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:09.193784 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:09.210519 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.210486 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b4rfl" event={"ID":"cac480a5-23cc-4692-9ed9-835ce99fd71b","Type":"ContainerStarted","Data":"883cc40b174eb184282b904fcb36c0cb60e92c3967afe6a05e6498758ac476a8"} Jul 28 13:43:09.212917 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.212890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"663b6d05b45c014682e498bb03b3716fc3cf1d82fdb730745b70b5ada29f66c9"} Jul 28 13:43:09.236153 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.236121 2566 generic.go:356] "Generic (PLEG): container finished" podID="e00b2cc629bdf6b35c44037fc78427b4" containerID="215fc1086077c7a4da5af68582099fd9f2554e07a9e237986b2572a647fbeb93" exitCode=0 Jul 28 13:43:09.237075 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.237042 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" event={"ID":"e00b2cc629bdf6b35c44037fc78427b4","Type":"ContainerDied","Data":"215fc1086077c7a4da5af68582099fd9f2554e07a9e237986b2572a647fbeb93"} Jul 28 13:43:09.249904 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.249686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z6qmq" event={"ID":"29b4e541-65ae-4874-9d60-76bec859fbe0","Type":"ContainerStarted","Data":"b19b1b3d81be6ab40a8f0dcf6d3f836247c3b668e77a2937f26381d06b2fe0c8"} Jul 28 13:43:09.258531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.258480 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pnh9c" event={"ID":"f41c1866-949d-4ad4-928d-4a553af076ec","Type":"ContainerStarted","Data":"081aee31468fa520c879e4805deccebf9f1ccd006104cc622bd3a06936d38bd2"} Jul 28 13:43:09.266150 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.266074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwdhd" event={"ID":"909de677-86e1-4962-90b8-ae7a5a4e875f","Type":"ContainerStarted","Data":"5295e6c7d86fc86388f7c607486681bfb48fc279538a87975909d9d658eb641e"} Jul 28 13:43:09.287493 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.287409 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerStarted","Data":"7e99b6ea3f576028a3b7009f2f7a6ab4e3bad673e6b32bada9094413e19a9d39"} Jul 28 13:43:09.314313 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.314284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" event={"ID":"e80f3fd793768cfa4cf0588123d22c76","Type":"ContainerStarted","Data":"92b3aafdf72e83afaff6ae23de6cbb7e07ee67dc99b782d21e7b93a37f8f70ab"} Jul 28 13:43:09.331591 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.331537 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-220.ec2.internal" podStartSLOduration=3.331519984 podStartE2EDuration="3.331519984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:09.330072436 +0000 UTC m=+4.671368070" watchObservedRunningTime="2026-07-28 13:43:09.331519984 +0000 UTC m=+4.672815618" Jul 28 13:43:09.338148 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.337943 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ht7bq" event={"ID":"342902a2-1fcf-4b69-93d5-c3b95c60af33","Type":"ContainerStarted","Data":"217bf73351b5239bbc62e45eca9cddb0fbd66a15f1ab50f0035e525b86371d62"} Jul 28 13:43:09.357274 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.357245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" event={"ID":"065652d1-71b1-44b0-96fa-159cdad5012e","Type":"ContainerStarted","Data":"5fed857933934d2d93f633c1a7949041b4aa5a220b474953b9022b755c49491d"} Jul 28 13:43:09.361132 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:09.361108 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" event={"ID":"3f3f6359-b763-44bb-b068-403ce35f8083","Type":"ContainerStarted","Data":"f2266bd4f79e0ea7caa496058f570e1747a4d335824b0f5f746c186befa7c951"} Jul 28 13:43:10.191403 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.191372 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:10.191936 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.191521 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:10.192000 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.191977 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:10.192089 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.192067 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:10.396367 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.396262 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" event={"ID":"e00b2cc629bdf6b35c44037fc78427b4","Type":"ContainerStarted","Data":"216450e49459f143e855d0250971cfd9188f19c9563656296e2148f6913ddeaa"} Jul 28 13:43:10.411945 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.411886 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-220.ec2.internal" podStartSLOduration=4.411868459 podStartE2EDuration="4.411868459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:10.411044567 +0000 UTC m=+5.752340203" watchObservedRunningTime="2026-07-28 13:43:10.411868459 +0000 UTC m=+5.753164093" Jul 28 13:43:10.749778 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.749742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:10.749977 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.749812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:10.749977 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.749961 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:10.750091 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.750016 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:14.749997846 +0000 UTC m=+10.091293483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:10.750091 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.750087 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:10.750201 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.750122 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:14.750111502 +0000 UTC m=+10.091407126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:10.850844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:10.850810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:10.851775 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.851016 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:10.851775 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.851037 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:10.851775 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.851050 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:10.851775 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:10.851105 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:14.851086824 +0000 UTC m=+10.192382450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:11.191493 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:11.191410 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:11.191922 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:11.191555 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:12.191550 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:12.191519 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:12.191992 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:12.191657 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:12.191992 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:12.191937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:12.192125 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:12.192043 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:13.191731 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:13.191701 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:13.192203 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:13.191842 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:14.191953 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:14.191308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:14.191953 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.191455 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:14.191953 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:14.191308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:14.191953 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.191913 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:14.785978 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:14.785937 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:14.786143 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:14.786016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:14.786143 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.786114 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:14.786307 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.786114 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:14.786307 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.786182 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:22.786161622 +0000 UTC m=+18.127457256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:14.786307 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.786252 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:22.786239344 +0000 UTC m=+18.127534965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:14.886658 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:14.886619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:14.886815 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.886784 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:14.886815 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.886812 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:14.886936 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.886824 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:14.886936 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:14.886884 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:22.886865111 +0000 UTC m=+18.228160744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:15.193334 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:15.192848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:15.193334 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:15.192961 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:16.191939 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:16.191905 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:16.192103 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:16.192028 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:16.192103 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:16.192075 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:16.192325 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:16.192178 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:17.192186 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:17.191737 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:17.192186 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:17.191855 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:18.191756 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:18.191728 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:18.191952 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:18.191728 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:18.191952 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:18.191851 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:18.191952 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:18.191944 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:19.192025 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:19.192001 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:19.192321 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:19.192105 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:20.192036 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:20.192000 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:20.192465 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:20.192050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:20.192465 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:20.192163 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:20.192465 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:20.192322 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:21.191404 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:21.191359 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:21.191574 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:21.191489 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:22.191946 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:22.191913 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:22.192517 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.192027 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:22.192517 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:22.192084 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:22.192517 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.192181 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:22.847578 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:22.847551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:22.847756 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:22.847605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:22.847756 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.847689 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:22.847756 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.847704 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:22.847756 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.847747 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:38.847730874 +0000 UTC m=+34.189026485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:22.847756 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.847760 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:38.847753955 +0000 UTC m=+34.189049565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:22.948584 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:22.948549 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:22.948735 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.948720 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:22.948784 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.948741 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:22.948784 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.948751 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:22.948874 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:22.948809 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:43:38.948790708 +0000 UTC m=+34.290086344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:23.192196 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:23.192167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:23.192599 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:23.192312 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:24.191482 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:24.191449 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:24.191692 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:24.191583 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:24.191692 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:24.191639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:24.191798 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:24.191736 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:25.191998 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:25.191953 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:25.192485 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:25.192059 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:26.191692 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:26.191649 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:26.191873 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:26.191787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:26.191873 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:26.191809 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:26.191994 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:26.191950 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:27.192031 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.191954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:27.192382 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:27.192087 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:27.429778 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.429537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ht7bq" event={"ID":"342902a2-1fcf-4b69-93d5-c3b95c60af33","Type":"ContainerStarted","Data":"aea811d5ce2bb93949c1590fd36681de4cb8dcaaf1b975eca34f2a5ffac7ca7b"} Jul 28 13:43:27.430956 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.430932 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" event={"ID":"065652d1-71b1-44b0-96fa-159cdad5012e","Type":"ContainerStarted","Data":"9c7430b7bf6f10aee7deace883212d9dd4e49a8b1c8a2cb79435aed3ae824cbc"} Jul 28 13:43:27.432370 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.432337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" event={"ID":"3f3f6359-b763-44bb-b068-403ce35f8083","Type":"ContainerStarted","Data":"2d987c4094b62e65519d65814a7f9b96b6646a99f432e071cd85b5e90519553d"} Jul 28 13:43:27.433770 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.433751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b4rfl" event={"ID":"cac480a5-23cc-4692-9ed9-835ce99fd71b","Type":"ContainerStarted","Data":"1b611ef67c54af8985905b282f07fcfe6f92a72d18dcef05f624a46106e2df62"} Jul 28 13:43:27.435159 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.435140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"2dd2c87306e3bd23b3ab777a30f7a55712fc0b00ba3d9c2fc819c10bc3522df9"} Jul 28 13:43:27.436424 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.436406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z6qmq" event={"ID":"29b4e541-65ae-4874-9d60-76bec859fbe0","Type":"ContainerStarted","Data":"8402f892d60795b383bc0448f70ab39ac3d9f7fee732f9be8155fbfe14cedbdd"} Jul 28 13:43:27.441071 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.441051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwdhd" event={"ID":"909de677-86e1-4962-90b8-ae7a5a4e875f","Type":"ContainerStarted","Data":"0d7b36c881f614535b337657c109dc7b68abdbac4ad78d1c933a512d9ec6dd10"} Jul 28 13:43:27.442557 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.442529 2566 generic.go:356] "Generic (PLEG): container finished" podID="3769c3b5-31ef-45e8-bebf-0bde9679ebd3" containerID="c33e6249e5432c751243c71a3347460888c38bb181a396a67dd81858d9fd255e" exitCode=0 Jul 28 13:43:27.442642 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.442570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerDied","Data":"c33e6249e5432c751243c71a3347460888c38bb181a396a67dd81858d9fd255e"} Jul 28 13:43:27.446332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.446283 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ht7bq" podStartSLOduration=7.872986775 podStartE2EDuration="22.446267064s" totalImagesPullingTime="14.573280289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:27.445625451 +0000 UTC m=+22.786921083" watchObservedRunningTime="2026-07-28 13:43:27.446267064 +0000 UTC m=+22.787562698" Jul 28 13:43:27.465282 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.465249 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zpwhh" podStartSLOduration=3.632290981 podStartE2EDuration="22.465238317s" totalImagesPullingTime="18.832947336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:27.465016286 +0000 UTC m=+22.806311919" watchObservedRunningTime="2026-07-28 13:43:27.465238317 +0000 UTC m=+22.806533944" Jul 28 13:43:27.480322 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.480291 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b4rfl" podStartSLOduration=3.64938855 podStartE2EDuration="22.480283952s" totalImagesPullingTime="18.830895402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:27.480048132 +0000 UTC m=+22.821343765" watchObservedRunningTime="2026-07-28 13:43:27.480283952 +0000 UTC m=+22.821579585" Jul 28 13:43:27.502807 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.502773 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gwdhd" podStartSLOduration=3.656178343 podStartE2EDuration="22.502761389s" totalImagesPullingTime="18.846583046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:27.502353206 +0000 UTC m=+22.843648841" watchObservedRunningTime="2026-07-28 13:43:27.502761389 +0000 UTC m=+22.844057021" Jul 28 13:43:27.541307 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:27.541271 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z6qmq" podStartSLOduration=3.715422279 podStartE2EDuration="22.541259288s" totalImagesPullingTime="18.825837009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:27.518493407 +0000 UTC m=+22.859789039" watchObservedRunningTime="2026-07-28 13:43:27.541259288 +0000 UTC m=+22.882554921" Jul 28 13:43:28.191637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.191453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:28.191940 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.191473 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:28.191940 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:28.191742 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:28.191940 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:28.191831 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:28.447820 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.447760 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:43:28.448244 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.448173 2566 generic.go:356] "Generic (PLEG): container finished" podID="03a622cd-d09c-46df-944d-f746438788d5" containerID="d84b8b9d6dc7761675457aa19d3230f0ee7d92a104efeb8b6542b486b241c398" exitCode=1 Jul 28 13:43:28.448244 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.448220 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"5feeefb0d1da392f46da5c33324afda1cbce73f1810fac3fa7775ce8e13cfe76"} Jul 28 13:43:28.448410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.448315 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"9b9f37c68fec20ce4e82143c7ee71283bf22f05b49631f6cbd7273baed34c7d7"} Jul 28 13:43:28.448410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.448376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"193b54390633ed251cb05238a72516fd6b5ff73129f347d6a9a1a79eced8aae7"} Jul 28 13:43:28.448515 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.448426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"b9b6c4b109dd6d1fc3149973be7d0efc4b157c3604c70f3f901b5a667b3ff4bb"} Jul 28 13:43:28.448515 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.448475 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerDied","Data":"d84b8b9d6dc7761675457aa19d3230f0ee7d92a104efeb8b6542b486b241c398"} Jul 28 13:43:28.450553 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.450382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pnh9c" event={"ID":"f41c1866-949d-4ad4-928d-4a553af076ec","Type":"ContainerStarted","Data":"5dce55cc55a3cd0b56d40d8a6d9ecf9f96208585ae7f2423edec23aa1b6c3bf5"} Jul 28 13:43:28.466525 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.466488 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pnh9c" podStartSLOduration=4.640297011 podStartE2EDuration="23.466471943s" totalImagesPullingTime="18.826174932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:28.465927693 +0000 UTC m=+23.807223318" watchObservedRunningTime="2026-07-28 13:43:28.466471943 +0000 UTC m=+23.807767578" Jul 28 13:43:28.626668 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:28.626644 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 13:43:29.076259 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:29.076138 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T13:43:28.626664242Z","UUID":"d79f9423-49c5-4503-96d0-6a41e8a61eed","Handler":null,"Name":"","Endpoint":""} Jul 28 13:43:29.077507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:29.077484 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 13:43:29.077628 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:29.077518 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 13:43:29.191748 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:29.191716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:29.192004 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:29.191855 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:29.455021 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:29.454983 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" event={"ID":"065652d1-71b1-44b0-96fa-159cdad5012e","Type":"ContainerStarted","Data":"b6ca8dcc1418202a09d36bb0c90d29aa4e1baf5b91f8321e98fe08917f31402f"} Jul 28 13:43:29.744571 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:29.744498 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:30.191211 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:30.191189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:30.191393 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:30.191322 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:30.191393 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:30.191378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:30.191515 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:30.191488 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:31.191993 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:31.191963 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:31.192459 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:31.192087 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:31.196721 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:31.196694 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:31.197597 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:31.197580 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:31.459555 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:31.459497 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ht7bq" Jul 28 13:43:32.191520 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.191352 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:32.191712 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.191408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:32.191712 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:32.191595 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:32.191712 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:32.191668 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:32.462481 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.462414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" event={"ID":"065652d1-71b1-44b0-96fa-159cdad5012e","Type":"ContainerStarted","Data":"5cc440b7cdeadb96c4a681db29338368aa5019f66b88df9929c1fc9ea82882f3"} Jul 28 13:43:32.465368 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.465350 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:43:32.465711 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.465694 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"a54b77415fcf9d1b18f12716fef384a21274dcebe4f3fbc7aca5941db7937b80"} Jul 28 13:43:32.467322 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.467302 2566 generic.go:356] "Generic (PLEG): container finished" podID="3769c3b5-31ef-45e8-bebf-0bde9679ebd3" containerID="1f4e5f8e1bc5f2d964801e5260b5dbc6efc5ff9440ab53137445d2bd1cb58889" exitCode=0 Jul 28 13:43:32.467419 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.467368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerDied","Data":"1f4e5f8e1bc5f2d964801e5260b5dbc6efc5ff9440ab53137445d2bd1cb58889"} Jul 28 13:43:32.483192 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:32.483149 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8vsb" podStartSLOduration=4.313024203 podStartE2EDuration="27.483138474s" totalImagesPullingTime="23.170114271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:32.482844536 +0000 UTC m=+27.824140169" watchObservedRunningTime="2026-07-28 13:43:32.483138474 +0000 UTC m=+27.824434106" Jul 28 13:43:33.191454 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:33.191421 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:33.191605 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:33.191540 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:34.191532 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.191374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:34.192109 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.191376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:34.192109 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:34.191609 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:34.192109 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:34.191700 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:34.474655 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.474582 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:43:34.474945 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.474912 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"b6545c06371b17d0c739f09ece93cb7e884b433febccb706ac42ff3936782d04"} Jul 28 13:43:34.475155 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.475135 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:34.475379 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.475358 2566 scope.go:117] "RemoveContainer" containerID="d84b8b9d6dc7761675457aa19d3230f0ee7d92a104efeb8b6542b486b241c398" Jul 28 13:43:34.477122 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.477099 2566 generic.go:356] "Generic (PLEG): container finished" podID="3769c3b5-31ef-45e8-bebf-0bde9679ebd3" containerID="af275132258370d74c92e00d38c6a2e5af8c4b2a53fcbd96448bb7d1a8f91592" exitCode=0 Jul 28 13:43:34.477254 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.477138 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerDied","Data":"af275132258370d74c92e00d38c6a2e5af8c4b2a53fcbd96448bb7d1a8f91592"} Jul 28 13:43:34.491439 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:34.491420 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:35.192554 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.192524 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:35.193010 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:35.192649 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:35.484806 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.484739 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:43:35.485134 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.485111 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" event={"ID":"03a622cd-d09c-46df-944d-f746438788d5","Type":"ContainerStarted","Data":"ced47e77177d6485311b0e63af7f7f7322ad8349bf3f4b3232485a23338c6dcf"} Jul 28 13:43:35.485239 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.485204 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:43:35.485519 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.485489 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:35.499735 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.499714 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:35.512040 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.512002 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" podStartSLOduration=11.458686767 podStartE2EDuration="30.511990671s" totalImagesPullingTime="19.053303904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:35.511728632 +0000 UTC m=+30.853024302" watchObservedRunningTime="2026-07-28 13:43:35.511990671 +0000 UTC m=+30.853286305" Jul 28 13:43:35.993798 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.993637 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfp42"] Jul 28 13:43:35.993926 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.993888 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:35.994003 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:35.993977 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:35.996985 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.996959 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sp6g4"] Jul 28 13:43:35.997131 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.997083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:35.997210 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:35.997190 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:35.997685 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.997661 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-df58h"] Jul 28 13:43:35.997787 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:35.997764 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:35.997881 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:35.997860 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:36.490682 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:36.490654 2566 generic.go:356] "Generic (PLEG): container finished" podID="3769c3b5-31ef-45e8-bebf-0bde9679ebd3" containerID="eeb78f6ef379e58cc71a8d15a336e925354343e9b402086cf95402a9374ce1b2" exitCode=0 Jul 28 13:43:36.491008 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:36.490745 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerDied","Data":"eeb78f6ef379e58cc71a8d15a336e925354343e9b402086cf95402a9374ce1b2"} Jul 28 13:43:36.491008 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:36.490788 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:43:36.491966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:36.491949 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:37.192118 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:37.192088 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:37.192339 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:37.192274 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:38.191982 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:38.191949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:38.191982 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:38.191974 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:38.192385 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.192068 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sp6g4" podUID="dfcc0950-639c-40b6-8fdd-dfd780e0b6c9" Jul 28 13:43:38.192385 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.192184 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfp42" podUID="6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b" Jul 28 13:43:38.507617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:38.507537 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nx7bb" Jul 28 13:43:38.875546 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:38.875461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:38.875546 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:38.875507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:38.875769 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.875626 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:38.875769 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.875680 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:38.875769 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.875700 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret podName:6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b nodeName:}" failed. No retries permitted until 2026-07-28 13:44:10.875681483 +0000 UTC m=+66.216977097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret") pod "global-pull-secret-syncer-cfp42" (UID: "6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:43:38.875769 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.875737 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs podName:dfcc0950-639c-40b6-8fdd-dfd780e0b6c9 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:10.875719157 +0000 UTC m=+66.217014769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs") pod "network-metrics-daemon-sp6g4" (UID: "dfcc0950-639c-40b6-8fdd-dfd780e0b6c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:43:38.976753 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:38.976722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:38.976892 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.976863 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:43:38.976892 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.976880 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:43:38.976892 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.976891 2566 projected.go:196] Error preparing data for projected volume kube-api-access-qw2hz for pod openshift-network-diagnostics/network-check-target-df58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:38.977056 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:38.976937 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz podName:8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b nodeName:}" failed. No retries permitted until 2026-07-28 13:44:10.976922886 +0000 UTC m=+66.318218509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qw2hz" (UniqueName: "kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz") pod "network-check-target-df58h" (UID: "8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:39.191283 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:39.191246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:39.191445 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:39.191394 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df58h" podUID="8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b" Jul 28 13:43:40.006049 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.006020 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-220.ec2.internal" event="NodeReady" Jul 28 13:43:40.006507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.006182 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 13:43:40.055810 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.055782 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qns6w"] Jul 28 13:43:40.058346 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.058325 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.060399 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.060375 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7r4zt"] Jul 28 13:43:40.060635 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.060611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 13:43:40.060718 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.060626 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 13:43:40.061853 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.061825 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8spsv\"" Jul 28 13:43:40.064829 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.064152 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.066262 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.066244 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 13:43:40.066770 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.066748 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8rh7w\"" Jul 28 13:43:40.067012 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.066995 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 13:43:40.067102 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.067089 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 13:43:40.072553 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.072529 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7r4zt"] Jul 28 13:43:40.079220 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.079202 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qns6w"] Jul 28 13:43:40.186438 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.186405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz4h6\" (UniqueName: \"kubernetes.io/projected/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-kube-api-access-bz4h6\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.186438 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.186447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-tmp-dir\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.186634 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.186479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-config-volume\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.186634 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.186521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.186634 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.186541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f8a677-83cc-4afa-a08c-6036a27c657a-cert\") pod \"ingress-canary-7r4zt\" (UID: \"e5f8a677-83cc-4afa-a08c-6036a27c657a\") " pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.186634 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.186557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwpt8\" (UniqueName: \"kubernetes.io/projected/e5f8a677-83cc-4afa-a08c-6036a27c657a-kube-api-access-dwpt8\") pod \"ingress-canary-7r4zt\" (UID: \"e5f8a677-83cc-4afa-a08c-6036a27c657a\") " pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.191472 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.191452 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:43:40.191657 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.191630 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:43:40.195329 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.195308 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:43:40.195421 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.195343 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:43:40.195474 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.195447 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7bxcb\"" Jul 28 13:43:40.287724 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.287640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz4h6\" (UniqueName: \"kubernetes.io/projected/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-kube-api-access-bz4h6\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.287724 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.287679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-tmp-dir\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.287724 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.287708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-config-volume\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.287964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.288021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f8a677-83cc-4afa-a08c-6036a27c657a-cert\") pod \"ingress-canary-7r4zt\" (UID: \"e5f8a677-83cc-4afa-a08c-6036a27c657a\") " pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.288048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwpt8\" (UniqueName: \"kubernetes.io/projected/e5f8a677-83cc-4afa-a08c-6036a27c657a-kube-api-access-dwpt8\") pod \"ingress-canary-7r4zt\" (UID: \"e5f8a677-83cc-4afa-a08c-6036a27c657a\") " pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.288111 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-tmp-dir\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:40.288128 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:40.288206 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls podName:f03648b4-6f6a-4973-b0b6-9eafd512d3f0 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:40.788184696 +0000 UTC m=+36.129480314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls") pod "dns-default-qns6w" (UID: "f03648b4-6f6a-4973-b0b6-9eafd512d3f0") : secret "dns-default-metrics-tls" not found Jul 28 13:43:40.288310 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.288290 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-config-volume\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.292455 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.292436 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f8a677-83cc-4afa-a08c-6036a27c657a-cert\") pod \"ingress-canary-7r4zt\" (UID: \"e5f8a677-83cc-4afa-a08c-6036a27c657a\") " pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.296382 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.296364 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz4h6\" (UniqueName: \"kubernetes.io/projected/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-kube-api-access-bz4h6\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.296583 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.296567 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwpt8\" (UniqueName: \"kubernetes.io/projected/e5f8a677-83cc-4afa-a08c-6036a27c657a-kube-api-access-dwpt8\") pod \"ingress-canary-7r4zt\" (UID: \"e5f8a677-83cc-4afa-a08c-6036a27c657a\") " pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.378670 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.378632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7r4zt" Jul 28 13:43:40.647239 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.647093 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7r4zt"] Jul 28 13:43:40.650052 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:40.650024 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f8a677_83cc_4afa_a08c_6036a27c657a.slice/crio-64b22ed234e49cf3c2004385ebd6a82b1b9758a99afa85b9412d3349c8151728 WatchSource:0}: Error finding container 64b22ed234e49cf3c2004385ebd6a82b1b9758a99afa85b9412d3349c8151728: Status 404 returned error can't find the container with id 64b22ed234e49cf3c2004385ebd6a82b1b9758a99afa85b9412d3349c8151728 Jul 28 13:43:40.792398 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:40.792372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:40.792531 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:40.792513 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:40.792586 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:40.792578 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls podName:f03648b4-6f6a-4973-b0b6-9eafd512d3f0 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:41.792563644 +0000 UTC m=+37.133859258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls") pod "dns-default-qns6w" (UID: "f03648b4-6f6a-4973-b0b6-9eafd512d3f0") : secret "dns-default-metrics-tls" not found Jul 28 13:43:41.191284 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.191174 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:43:41.194041 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.194009 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:43:41.194041 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.194032 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzm8z\"" Jul 28 13:43:41.194213 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.194062 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:43:41.504810 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.504720 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7r4zt" event={"ID":"e5f8a677-83cc-4afa-a08c-6036a27c657a","Type":"ContainerStarted","Data":"64b22ed234e49cf3c2004385ebd6a82b1b9758a99afa85b9412d3349c8151728"} Jul 28 13:43:41.507775 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.507743 2566 generic.go:356] "Generic (PLEG): container finished" podID="3769c3b5-31ef-45e8-bebf-0bde9679ebd3" containerID="93687a24409da4d999e0fd87e8895c8b8c542b8fd2577e67cb5eb25edfbd6543" exitCode=0 Jul 28 13:43:41.507910 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.507783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerDied","Data":"93687a24409da4d999e0fd87e8895c8b8c542b8fd2577e67cb5eb25edfbd6543"} Jul 28 13:43:41.801093 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:41.801008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:41.801264 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:41.801112 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:41.801264 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:41.801177 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls podName:f03648b4-6f6a-4973-b0b6-9eafd512d3f0 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:43.801157836 +0000 UTC m=+39.142453447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls") pod "dns-default-qns6w" (UID: "f03648b4-6f6a-4973-b0b6-9eafd512d3f0") : secret "dns-default-metrics-tls" not found Jul 28 13:43:42.514370 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:42.514331 2566 generic.go:356] "Generic (PLEG): container finished" podID="3769c3b5-31ef-45e8-bebf-0bde9679ebd3" containerID="b01220b478f05ed4e8ed6d201466081c064147c0bc52d01bda6bd6d14b4a6b1b" exitCode=0 Jul 28 13:43:42.514814 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:42.514386 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerDied","Data":"b01220b478f05ed4e8ed6d201466081c064147c0bc52d01bda6bd6d14b4a6b1b"} Jul 28 13:43:43.517586 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:43.517546 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7r4zt" event={"ID":"e5f8a677-83cc-4afa-a08c-6036a27c657a","Type":"ContainerStarted","Data":"c41fb1db0e67c8ff7954bf727ac81b2a491c30831dc44161b72e3b2b58542a65"} Jul 28 13:43:43.521274 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:43.521248 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j48v7" event={"ID":"3769c3b5-31ef-45e8-bebf-0bde9679ebd3","Type":"ContainerStarted","Data":"9f13938b0a840e7729196d2269cf71c8e013d34bc1c9138d6be52a105d08d5b7"} Jul 28 13:43:43.532909 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:43.532868 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7r4zt" podStartSLOduration=1.0391760780000001 podStartE2EDuration="3.532854147s" totalImagesPullingTime="2.493678069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:43.532273432 +0000 UTC m=+38.873569065" watchObservedRunningTime="2026-07-28 13:43:43.532854147 +0000 UTC m=+38.874149779" Jul 28 13:43:43.553756 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:43.553714 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j48v7" podStartSLOduration=9.078387666 podStartE2EDuration="38.553700007s" totalImagesPullingTime="29.475312341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:43.552898335 +0000 UTC m=+38.894193968" watchObservedRunningTime="2026-07-28 13:43:43.553700007 +0000 UTC m=+38.894995640" Jul 28 13:43:43.815598 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:43.815521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:43.815727 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:43.815624 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:43.815727 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:43.815677 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls podName:f03648b4-6f6a-4973-b0b6-9eafd512d3f0 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:47.815662198 +0000 UTC m=+43.156957810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls") pod "dns-default-qns6w" (UID: "f03648b4-6f6a-4973-b0b6-9eafd512d3f0") : secret "dns-default-metrics-tls" not found Jul 28 13:43:47.842323 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:47.842117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:47.842690 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:47.842272 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:47.842690 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:47.842417 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls podName:f03648b4-6f6a-4973-b0b6-9eafd512d3f0 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:55.842401759 +0000 UTC m=+51.183697370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls") pod "dns-default-qns6w" (UID: "f03648b4-6f6a-4973-b0b6-9eafd512d3f0") : secret "dns-default-metrics-tls" not found Jul 28 13:43:48.952721 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:48.952680 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2"] Jul 28 13:43:48.984178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:48.984153 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2"] Jul 28 13:43:48.984312 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:48.984262 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" Jul 28 13:43:48.991033 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:48.991013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:43:48.991161 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:48.991018 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7tf9m\"" Jul 28 13:43:48.991484 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:48.991466 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 13:43:49.049547 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.049515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qbw\" (UniqueName: \"kubernetes.io/projected/b94ec497-3bd3-4b87-915a-c3bd2955246a-kube-api-access-c4qbw\") pod \"volume-data-source-validator-549c6d54cf-fbtp2\" (UID: \"b94ec497-3bd3-4b87-915a-c3bd2955246a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" Jul 28 13:43:49.059174 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.059145 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-8h7js"] Jul 28 13:43:49.078268 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.078247 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x"] Jul 28 13:43:49.078354 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.078338 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.080763 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.080748 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 13:43:49.080980 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.080965 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 13:43:49.081507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.081490 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 13:43:49.081653 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.081577 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:43:49.081930 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.081910 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-b8n2c\"" Jul 28 13:43:49.089819 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.089792 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 13:43:49.100334 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.100311 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-8h7js"] Jul 28 13:43:49.100435 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.100343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x"] Jul 28 13:43:49.100435 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.100425 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.103388 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.103373 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 13:43:49.103465 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.103403 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:43:49.103465 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.103415 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 13:43:49.103707 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.103692 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jq8tw\"" Jul 28 13:43:49.104413 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.104398 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 13:43:49.149806 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-trusted-ca\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.149885 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdl7r\" (UniqueName: \"kubernetes.io/projected/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-kube-api-access-pdl7r\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.149885 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e7cb077-c80f-43b8-a75e-951f88654519-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.149959 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e7cb077-c80f-43b8-a75e-951f88654519-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.149959 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd9xw\" (UniqueName: \"kubernetes.io/projected/3e7cb077-c80f-43b8-a75e-951f88654519-kube-api-access-wd9xw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.150024 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-config\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.150024 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.149996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qbw\" (UniqueName: \"kubernetes.io/projected/b94ec497-3bd3-4b87-915a-c3bd2955246a-kube-api-access-c4qbw\") pod \"volume-data-source-validator-549c6d54cf-fbtp2\" (UID: \"b94ec497-3bd3-4b87-915a-c3bd2955246a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" Jul 28 13:43:49.150087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.150025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-serving-cert\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.154012 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.153995 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-864dc66f5f-52wc4"] Jul 28 13:43:49.170065 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.170038 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qbw\" (UniqueName: \"kubernetes.io/projected/b94ec497-3bd3-4b87-915a-c3bd2955246a-kube-api-access-c4qbw\") pod \"volume-data-source-validator-549c6d54cf-fbtp2\" (UID: \"b94ec497-3bd3-4b87-915a-c3bd2955246a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" Jul 28 13:43:49.176139 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.176122 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.178741 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.178716 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 13:43:49.178741 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.178730 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 13:43:49.179574 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.179556 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-864dc66f5f-52wc4"] Jul 28 13:43:49.179940 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.179915 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 13:43:49.179940 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.179933 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 13:43:49.180072 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.179967 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 13:43:49.180072 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.179968 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 13:43:49.180072 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.179994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-84krf\"" Jul 28 13:43:49.250527 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd9xw\" (UniqueName: \"kubernetes.io/projected/3e7cb077-c80f-43b8-a75e-951f88654519-kube-api-access-wd9xw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.250527 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-config\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.250663 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-stats-auth\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.250663 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-serving-cert\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.250663 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-default-certificate\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.250663 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250635 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-trusted-ca\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.250809 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdl7r\" (UniqueName: \"kubernetes.io/projected/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-kube-api-access-pdl7r\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.250809 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z2mg\" (UniqueName: \"kubernetes.io/projected/d43f7756-30db-49ae-9aed-6f20c415bf75-kube-api-access-7z2mg\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.250896 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e7cb077-c80f-43b8-a75e-951f88654519-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.250949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.251009 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e7cb077-c80f-43b8-a75e-951f88654519-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.251009 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.250993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.251340 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.251312 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-config\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.251486 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.251467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e7cb077-c80f-43b8-a75e-951f88654519-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.251662 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.251643 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-trusted-ca\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.252914 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.252894 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e7cb077-c80f-43b8-a75e-951f88654519-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.252968 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.252902 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-serving-cert\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.259298 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.259273 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdl7r\" (UniqueName: \"kubernetes.io/projected/95e3939b-e7c0-4324-ba77-fe66ef6b1a0c-kube-api-access-pdl7r\") pod \"console-operator-584dcb6b54-8h7js\" (UID: \"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c\") " pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.259372 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.259331 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd9xw\" (UniqueName: \"kubernetes.io/projected/3e7cb077-c80f-43b8-a75e-951f88654519-kube-api-access-wd9xw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x\" (UID: \"3e7cb077-c80f-43b8-a75e-951f88654519\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.293171 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.293154 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" Jul 28 13:43:49.352253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.352215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.352347 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.352291 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-stats-auth\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.352347 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.352315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-default-certificate\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.352539 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:49.352348 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:49.85233181 +0000 UTC m=+45.193627449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : configmap references non-existent config key: service-ca.crt Jul 28 13:43:49.352539 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.352374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z2mg\" (UniqueName: \"kubernetes.io/projected/d43f7756-30db-49ae-9aed-6f20c415bf75-kube-api-access-7z2mg\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.352539 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.352427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.352704 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:49.352548 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:43:49.352704 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:49.352599 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:49.852583466 +0000 UTC m=+45.193879077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : secret "router-metrics-certs-default" not found Jul 28 13:43:49.354490 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.354467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-default-certificate\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.354596 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.354543 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-stats-auth\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.361633 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.361611 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z2mg\" (UniqueName: \"kubernetes.io/projected/d43f7756-30db-49ae-9aed-6f20c415bf75-kube-api-access-7z2mg\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.388530 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.388504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:49.408478 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.408453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" Jul 28 13:43:49.438395 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.438368 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2"] Jul 28 13:43:49.442430 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:49.442403 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94ec497_3bd3_4b87_915a_c3bd2955246a.slice/crio-851cf3528f5f6d274bf046169d0ca3c5d8facd0c56a1abc62b577f5767d51212 WatchSource:0}: Error finding container 851cf3528f5f6d274bf046169d0ca3c5d8facd0c56a1abc62b577f5767d51212: Status 404 returned error can't find the container with id 851cf3528f5f6d274bf046169d0ca3c5d8facd0c56a1abc62b577f5767d51212 Jul 28 13:43:49.538073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.538047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" event={"ID":"b94ec497-3bd3-4b87-915a-c3bd2955246a","Type":"ContainerStarted","Data":"851cf3528f5f6d274bf046169d0ca3c5d8facd0c56a1abc62b577f5767d51212"} Jul 28 13:43:49.544728 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.544702 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-8h7js"] Jul 28 13:43:49.548056 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:49.548031 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e3939b_e7c0_4324_ba77_fe66ef6b1a0c.slice/crio-bdd8ebf9003e00ee0095880b1ecd5e16c3a9717bb1cf4e20af8eed6bfeb4abff WatchSource:0}: Error finding container bdd8ebf9003e00ee0095880b1ecd5e16c3a9717bb1cf4e20af8eed6bfeb4abff: Status 404 returned error can't find the container with id bdd8ebf9003e00ee0095880b1ecd5e16c3a9717bb1cf4e20af8eed6bfeb4abff Jul 28 13:43:49.563881 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.563855 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x"] Jul 28 13:43:49.566491 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:49.566468 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7cb077_c80f_43b8_a75e_951f88654519.slice/crio-de6e4f9a1ec2b830fc501518b23b76381f33b69ebe6d435221c5a5f71c0d54fd WatchSource:0}: Error finding container de6e4f9a1ec2b830fc501518b23b76381f33b69ebe6d435221c5a5f71c0d54fd: Status 404 returned error can't find the container with id de6e4f9a1ec2b830fc501518b23b76381f33b69ebe6d435221c5a5f71c0d54fd Jul 28 13:43:49.856445 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.856363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.856445 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:49.856415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:49.856627 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:49.856529 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:43:49.856627 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:49.856578 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:50.856565032 +0000 UTC m=+46.197860662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : configmap references non-existent config key: service-ca.crt Jul 28 13:43:49.856627 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:49.856594 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:50.856588965 +0000 UTC m=+46.197884588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : secret "router-metrics-certs-default" not found Jul 28 13:43:50.542383 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:50.542347 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" event={"ID":"3e7cb077-c80f-43b8-a75e-951f88654519","Type":"ContainerStarted","Data":"de6e4f9a1ec2b830fc501518b23b76381f33b69ebe6d435221c5a5f71c0d54fd"} Jul 28 13:43:50.543577 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:50.543547 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" event={"ID":"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c","Type":"ContainerStarted","Data":"bdd8ebf9003e00ee0095880b1ecd5e16c3a9717bb1cf4e20af8eed6bfeb4abff"} Jul 28 13:43:50.864389 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:50.864263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:50.864389 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:50.864346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:50.864592 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:50.864398 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:43:50.864592 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:50.864481 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:52.864458486 +0000 UTC m=+48.205754097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : secret "router-metrics-certs-default" not found Jul 28 13:43:50.864592 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:50.864497 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:52.864490301 +0000 UTC m=+48.205785912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : configmap references non-existent config key: service-ca.crt Jul 28 13:43:52.551134 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.551099 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" event={"ID":"b94ec497-3bd3-4b87-915a-c3bd2955246a","Type":"ContainerStarted","Data":"3543ec46bca1fafe18f83aa53da7e78054c293f199e1cb1761bf95daa6aa8090"} Jul 28 13:43:52.552913 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.552882 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" event={"ID":"3e7cb077-c80f-43b8-a75e-951f88654519","Type":"ContainerStarted","Data":"6b18dd41f98144d3ba9f52f286fffa3e4e5283dde2843661bc43cfff076090d1"} Jul 28 13:43:52.570099 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.570043 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fbtp2" podStartSLOduration=2.105785836 podStartE2EDuration="4.570023808s" totalImagesPullingTime="2.464237972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:52.568958825 +0000 UTC m=+47.910254460" watchObservedRunningTime="2026-07-28 13:43:52.570023808 +0000 UTC m=+47.911319442" Jul 28 13:43:52.585977 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.585935 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" podStartSLOduration=1.2395377459999999 podStartE2EDuration="3.585920099s" totalImagesPullingTime="2.346382353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:52.584893991 +0000 UTC m=+47.926189627" watchObservedRunningTime="2026-07-28 13:43:52.585920099 +0000 UTC m=+47.927215733" Jul 28 13:43:52.765343 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.765304 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w4qn7"] Jul 28 13:43:52.789467 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.789441 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4qn7"] Jul 28 13:43:52.789621 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.789570 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.792121 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.791926 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 13:43:52.792121 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.792027 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 13:43:52.793468 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.793446 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 13:43:52.793580 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.793567 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 13:43:52.793738 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.793713 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2kzl\"" Jul 28 13:43:52.885714 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.885638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:52.885714 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.885678 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-crio-socket\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.885896 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.885734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:52.885896 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.885782 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:43:52.885896 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.885790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.885896 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.885838 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:56.885824695 +0000 UTC m=+52.227120306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : secret "router-metrics-certs-default" not found Jul 28 13:43:52.886058 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.885905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.886058 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.885916 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:56.885897282 +0000 UTC m=+52.227192914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : configmap references non-existent config key: service-ca.crt Jul 28 13:43:52.886058 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.885972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-data-volume\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.886058 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.886001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8lv8\" (UniqueName: \"kubernetes.io/projected/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-api-access-x8lv8\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987050 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987246 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987062 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-data-volume\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987246 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8lv8\" (UniqueName: \"kubernetes.io/projected/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-api-access-x8lv8\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987246 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.987140 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:52.987246 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-crio-socket\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987246 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.987206 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:43:53.487187733 +0000 UTC m=+48.828483380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : configmap "kube-rbac-proxy" not found Jul 28 13:43:52.987507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987364 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-crio-socket\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987507 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.987422 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:52.987507 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.987422 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-data-volume\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:52.987507 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:52.987463 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:43:53.487450064 +0000 UTC m=+48.828745693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:52.997572 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:52.997550 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8lv8\" (UniqueName: \"kubernetes.io/projected/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-api-access-x8lv8\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:53.491059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:53.491027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:53.491176 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:53.491069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:53.491240 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:53.491180 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:53.491240 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:53.491212 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:53.491321 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:53.491259 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:43:54.491239843 +0000 UTC m=+49.832535460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:53.491321 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:53.491275 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:43:54.491267751 +0000 UTC m=+49.832563361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : configmap "kube-rbac-proxy" not found Jul 28 13:43:53.556506 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:53.556461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/0.log" Jul 28 13:43:53.556872 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:53.556500 2566 generic.go:356] "Generic (PLEG): container finished" podID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" containerID="2e9e9ab794218e4e41ead080f0fbf7dd034407ea81edd48c74fc774469225acb" exitCode=255 Jul 28 13:43:53.556872 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:53.556584 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" event={"ID":"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c","Type":"ContainerDied","Data":"2e9e9ab794218e4e41ead080f0fbf7dd034407ea81edd48c74fc774469225acb"} Jul 28 13:43:53.556872 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:53.556746 2566 scope.go:117] "RemoveContainer" containerID="2e9e9ab794218e4e41ead080f0fbf7dd034407ea81edd48c74fc774469225acb" Jul 28 13:43:54.499307 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.499272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:54.499307 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.499309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:54.499506 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:54.499437 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:54.499544 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:54.499443 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:54.499579 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:54.499527 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:43:56.499511467 +0000 UTC m=+51.840807079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:54.499579 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:54.499574 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:43:56.499562174 +0000 UTC m=+51.840857785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : configmap "kube-rbac-proxy" not found Jul 28 13:43:54.560781 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.560758 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/1.log" Jul 28 13:43:54.561176 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.561162 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/0.log" Jul 28 13:43:54.561246 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.561192 2566 generic.go:356] "Generic (PLEG): container finished" podID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" containerID="e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff" exitCode=255 Jul 28 13:43:54.561306 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.561244 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" event={"ID":"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c","Type":"ContainerDied","Data":"e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff"} Jul 28 13:43:54.561378 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.561364 2566 scope.go:117] "RemoveContainer" containerID="2e9e9ab794218e4e41ead080f0fbf7dd034407ea81edd48c74fc774469225acb" Jul 28 13:43:54.561554 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.561541 2566 scope.go:117] "RemoveContainer" containerID="e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff" Jul 28 13:43:54.561718 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:54.561697 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8h7js_openshift-console-operator(95e3939b-e7c0-4324-ba77-fe66ef6b1a0c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podUID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" Jul 28 13:43:54.655185 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.655158 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sf6pp"] Jul 28 13:43:54.678282 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.678260 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sf6pp"] Jul 28 13:43:54.678357 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.678303 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.682410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.682392 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 13:43:54.682638 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.682619 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 13:43:54.682752 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.682661 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 13:43:54.682752 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.682661 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8fr79\"" Jul 28 13:43:54.682752 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.682620 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 13:43:54.702126 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.702108 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5h4\" (UniqueName: \"kubernetes.io/projected/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-kube-api-access-xw5h4\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.702215 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.702138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-signing-key\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.702215 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.702174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-signing-cabundle\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.802564 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.802494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5h4\" (UniqueName: \"kubernetes.io/projected/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-kube-api-access-xw5h4\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.802564 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.802526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-signing-key\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.802564 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.802558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-signing-cabundle\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.803123 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.803104 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-signing-cabundle\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.804854 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.804836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-signing-key\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.815388 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.815370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5h4\" (UniqueName: \"kubernetes.io/projected/13a49d4f-d5ca-4c11-a87c-6240181c4c0a-kube-api-access-xw5h4\") pod \"service-ca-658d7b7c78-sf6pp\" (UID: \"13a49d4f-d5ca-4c11-a87c-6240181c4c0a\") " pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:54.918850 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.918830 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z6qmq_29b4e541-65ae-4874-9d60-76bec859fbe0/dns-node-resolver/0.log" Jul 28 13:43:54.986476 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:54.986443 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" Jul 28 13:43:55.112016 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:55.111994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sf6pp"] Jul 28 13:43:55.114323 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:43:55.114296 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a49d4f_d5ca_4c11_a87c_6240181c4c0a.slice/crio-30d41e378b1f7a6b32ce7d657078b1004f671739127676237d365647290f7d82 WatchSource:0}: Error finding container 30d41e378b1f7a6b32ce7d657078b1004f671739127676237d365647290f7d82: Status 404 returned error can't find the container with id 30d41e378b1f7a6b32ce7d657078b1004f671739127676237d365647290f7d82 Jul 28 13:43:55.517262 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:55.517236 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b4rfl_cac480a5-23cc-4692-9ed9-835ce99fd71b/node-ca/0.log" Jul 28 13:43:55.565062 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:55.565040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/1.log" Jul 28 13:43:55.565443 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:55.565374 2566 scope.go:117] "RemoveContainer" containerID="e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff" Jul 28 13:43:55.565542 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:55.565517 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8h7js_openshift-console-operator(95e3939b-e7c0-4324-ba77-fe66ef6b1a0c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podUID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" Jul 28 13:43:55.566166 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:55.566147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" event={"ID":"13a49d4f-d5ca-4c11-a87c-6240181c4c0a","Type":"ContainerStarted","Data":"30d41e378b1f7a6b32ce7d657078b1004f671739127676237d365647290f7d82"} Jul 28 13:43:55.909908 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:55.909831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:43:55.910054 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:55.909992 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:55.910101 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:55.910071 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls podName:f03648b4-6f6a-4973-b0b6-9eafd512d3f0 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:11.910051638 +0000 UTC m=+67.251347264 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls") pod "dns-default-qns6w" (UID: "f03648b4-6f6a-4973-b0b6-9eafd512d3f0") : secret "dns-default-metrics-tls" not found Jul 28 13:43:56.317562 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:56.317534 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7r4zt_e5f8a677-83cc-4afa-a08c-6036a27c657a/serve-healthcheck-canary/0.log" Jul 28 13:43:56.514631 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:56.514603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:56.514631 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:56.514635 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:43:56.514822 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.514729 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:56.514822 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.514757 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:56.514822 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.514781 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:44:00.514767852 +0000 UTC m=+55.856063462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : configmap "kube-rbac-proxy" not found Jul 28 13:43:56.514822 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.514809 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:44:00.51479658 +0000 UTC m=+55.856092192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:56.917723 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:56.917682 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:56.918213 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:56.917855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:43:56.918213 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.917897 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:04.917876041 +0000 UTC m=+60.259171652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : configmap references non-existent config key: service-ca.crt Jul 28 13:43:56.918213 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.917999 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:43:56.918213 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:56.918070 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs podName:d43f7756-30db-49ae-9aed-6f20c415bf75 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:04.918051605 +0000 UTC m=+60.259347243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs") pod "router-default-864dc66f5f-52wc4" (UID: "d43f7756-30db-49ae-9aed-6f20c415bf75") : secret "router-metrics-certs-default" not found Jul 28 13:43:57.575273 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:57.575240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" event={"ID":"13a49d4f-d5ca-4c11-a87c-6240181c4c0a","Type":"ContainerStarted","Data":"9d496aaa8e31b376d22dc9bf146ee9fb9e2fd769d5a1d7b0b2157531e195935c"} Jul 28 13:43:57.593278 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:57.593215 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-sf6pp" podStartSLOduration=1.329622406 podStartE2EDuration="3.593201119s" totalImagesPullingTime="2.263578713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:57.592128116 +0000 UTC m=+52.933423750" watchObservedRunningTime="2026-07-28 13:43:57.593201119 +0000 UTC m=+52.934496752" Jul 28 13:43:59.389554 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:59.389508 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:59.390206 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:59.389577 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:43:59.390206 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:43:59.389989 2566 scope.go:117] "RemoveContainer" containerID="e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff" Jul 28 13:43:59.390206 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:43:59.390154 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8h7js_openshift-console-operator(95e3939b-e7c0-4324-ba77-fe66ef6b1a0c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podUID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" Jul 28 13:44:00.543409 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:00.543372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:00.543848 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:00.543415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:00.543848 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:00.543518 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:44:00.543848 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:00.543557 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:44:00.543848 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:00.543590 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:44:08.543569298 +0000 UTC m=+63.884864909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : secret "insights-runtime-extractor-tls" not found Jul 28 13:44:00.543848 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:00.543608 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:44:08.543596358 +0000 UTC m=+63.884891969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : configmap "kube-rbac-proxy" not found Jul 28 13:44:04.980092 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:04.980057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:04.980092 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:04.980094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:04.980645 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:04.980627 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d43f7756-30db-49ae-9aed-6f20c415bf75-service-ca-bundle\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:04.982296 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:04.982269 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d43f7756-30db-49ae-9aed-6f20c415bf75-metrics-certs\") pod \"router-default-864dc66f5f-52wc4\" (UID: \"d43f7756-30db-49ae-9aed-6f20c415bf75\") " pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:05.087034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:05.087007 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-84krf\"" Jul 28 13:44:05.095936 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:05.095917 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:05.253606 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:05.253576 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-864dc66f5f-52wc4"] Jul 28 13:44:05.255928 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:05.255898 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43f7756_30db_49ae_9aed_6f20c415bf75.slice/crio-cb6ba2d27e24c5f7f7c9188bf1cda9b33bb1489c7b031ec36ed4a71e525153e2 WatchSource:0}: Error finding container cb6ba2d27e24c5f7f7c9188bf1cda9b33bb1489c7b031ec36ed4a71e525153e2: Status 404 returned error can't find the container with id cb6ba2d27e24c5f7f7c9188bf1cda9b33bb1489c7b031ec36ed4a71e525153e2 Jul 28 13:44:05.602686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:05.602613 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-864dc66f5f-52wc4" event={"ID":"d43f7756-30db-49ae-9aed-6f20c415bf75","Type":"ContainerStarted","Data":"e235ddb2a6ff2a8e90c91c7c7c837b48567abcc3b8604581e6d35007866e4f1d"} Jul 28 13:44:05.602686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:05.602659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-864dc66f5f-52wc4" event={"ID":"d43f7756-30db-49ae-9aed-6f20c415bf75","Type":"ContainerStarted","Data":"cb6ba2d27e24c5f7f7c9188bf1cda9b33bb1489c7b031ec36ed4a71e525153e2"} Jul 28 13:44:05.623892 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:05.623847 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-864dc66f5f-52wc4" podStartSLOduration=16.623832084 podStartE2EDuration="16.623832084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:05.623034285 +0000 UTC m=+60.964329919" watchObservedRunningTime="2026-07-28 13:44:05.623832084 +0000 UTC m=+60.965127717" Jul 28 13:44:06.096125 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:06.096090 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:06.098461 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:06.098436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:06.606186 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:06.606156 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:06.607388 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:06.607369 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-864dc66f5f-52wc4" Jul 28 13:44:08.606294 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:08.606256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:08.606294 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:08.606293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:08.606711 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:08.606400 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:44:08.606711 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:08.606465 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls podName:bf75689e-2bb4-456c-bd7b-9a7f4006e4df nodeName:}" failed. No retries permitted until 2026-07-28 13:44:24.60644916 +0000 UTC m=+79.947744774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4qn7" (UID: "bf75689e-2bb4-456c-bd7b-9a7f4006e4df") : secret "insights-runtime-extractor-tls" not found Jul 28 13:44:08.606791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:08.606742 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:10.924261 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:10.924211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:44:10.924635 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:10.924322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:44:10.926714 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:10.926694 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:44:10.927371 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:10.927357 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:44:10.937291 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:10.937257 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b-original-pull-secret\") pod \"global-pull-secret-syncer-cfp42\" (UID: \"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b\") " pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:44:10.937291 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:10.937283 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfcc0950-639c-40b6-8fdd-dfd780e0b6c9-metrics-certs\") pod \"network-metrics-daemon-sp6g4\" (UID: \"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9\") " pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:44:11.024811 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.024776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:44:11.027214 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.027199 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:44:11.037356 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.037336 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:44:11.047371 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.047345 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw2hz\" (UniqueName: \"kubernetes.io/projected/8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b-kube-api-access-qw2hz\") pod \"network-check-target-df58h\" (UID: \"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b\") " pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:44:11.102769 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.102747 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfp42" Jul 28 13:44:11.111511 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.111493 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7bxcb\"" Jul 28 13:44:11.119352 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.119330 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sp6g4" Jul 28 13:44:11.192457 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.192435 2566 scope.go:117] "RemoveContainer" containerID="e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff" Jul 28 13:44:11.204587 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.204365 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzm8z\"" Jul 28 13:44:11.211686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.211669 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:44:11.235806 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.235771 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfp42"] Jul 28 13:44:11.248273 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.248193 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sp6g4"] Jul 28 13:44:11.250602 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:11.250574 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b98d0d6_0c9a_4d2e_90fb_9b0957418e6b.slice/crio-fb287a0d6b9436fb0798139617151595abc1655a9763f802375b125ce5511144 WatchSource:0}: Error finding container fb287a0d6b9436fb0798139617151595abc1655a9763f802375b125ce5511144: Status 404 returned error can't find the container with id fb287a0d6b9436fb0798139617151595abc1655a9763f802375b125ce5511144 Jul 28 13:44:11.251944 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:11.251909 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcc0950_639c_40b6_8fdd_dfd780e0b6c9.slice/crio-821a58a2e59174b1df2e86ed64024f39da877ac8d61f0998ad46f9924038e8e2 WatchSource:0}: Error finding container 821a58a2e59174b1df2e86ed64024f39da877ac8d61f0998ad46f9924038e8e2: Status 404 returned error can't find the container with id 821a58a2e59174b1df2e86ed64024f39da877ac8d61f0998ad46f9924038e8e2 Jul 28 13:44:11.343024 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.343000 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-df58h"] Jul 28 13:44:11.383997 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:11.383970 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc47e2e_7fdc_441c_a1ac_623d8e5ceb5b.slice/crio-8da55476638c26c500c22d2f7e13c2577cbbd810177513947ac14caf15a1e93d WatchSource:0}: Error finding container 8da55476638c26c500c22d2f7e13c2577cbbd810177513947ac14caf15a1e93d: Status 404 returned error can't find the container with id 8da55476638c26c500c22d2f7e13c2577cbbd810177513947ac14caf15a1e93d Jul 28 13:44:11.622689 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.622611 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:44:11.623022 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.623006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/1.log" Jul 28 13:44:11.623078 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.623051 2566 generic.go:356] "Generic (PLEG): container finished" podID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" containerID="a577a80228554b67f8091522dfb25f3eaa1abc2bfaf0254e72bc7718e7131879" exitCode=255 Jul 28 13:44:11.623161 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.623132 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" event={"ID":"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c","Type":"ContainerDied","Data":"a577a80228554b67f8091522dfb25f3eaa1abc2bfaf0254e72bc7718e7131879"} Jul 28 13:44:11.623307 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.623205 2566 scope.go:117] "RemoveContainer" containerID="e7cbf19c5cab83c01e064b529db1340346e6236587e654612f4abe8d194a6aff" Jul 28 13:44:11.623580 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.623561 2566 scope.go:117] "RemoveContainer" containerID="a577a80228554b67f8091522dfb25f3eaa1abc2bfaf0254e72bc7718e7131879" Jul 28 13:44:11.623755 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:11.623736 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-8h7js_openshift-console-operator(95e3939b-e7c0-4324-ba77-fe66ef6b1a0c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podUID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" Jul 28 13:44:11.624316 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.624292 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-df58h" event={"ID":"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b","Type":"ContainerStarted","Data":"8da55476638c26c500c22d2f7e13c2577cbbd810177513947ac14caf15a1e93d"} Jul 28 13:44:11.625341 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.625319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sp6g4" event={"ID":"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9","Type":"ContainerStarted","Data":"821a58a2e59174b1df2e86ed64024f39da877ac8d61f0998ad46f9924038e8e2"} Jul 28 13:44:11.626313 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.626293 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfp42" event={"ID":"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b","Type":"ContainerStarted","Data":"fb287a0d6b9436fb0798139617151595abc1655a9763f802375b125ce5511144"} Jul 28 13:44:11.932911 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.932881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:44:11.935315 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:11.935291 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03648b4-6f6a-4973-b0b6-9eafd512d3f0-metrics-tls\") pod \"dns-default-qns6w\" (UID: \"f03648b4-6f6a-4973-b0b6-9eafd512d3f0\") " pod="openshift-dns/dns-default-qns6w" Jul 28 13:44:12.175278 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:12.175145 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8spsv\"" Jul 28 13:44:12.183562 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:12.183345 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qns6w" Jul 28 13:44:12.361913 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:12.361885 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qns6w"] Jul 28 13:44:12.364319 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:12.364280 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03648b4_6f6a_4973_b0b6_9eafd512d3f0.slice/crio-d0cffcdf95d96e383eb4ab03276bbe2881b1253f5af9765c86cfefe9e6a5c611 WatchSource:0}: Error finding container d0cffcdf95d96e383eb4ab03276bbe2881b1253f5af9765c86cfefe9e6a5c611: Status 404 returned error can't find the container with id d0cffcdf95d96e383eb4ab03276bbe2881b1253f5af9765c86cfefe9e6a5c611 Jul 28 13:44:12.632542 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:12.632471 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:44:12.634145 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:12.634092 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qns6w" event={"ID":"f03648b4-6f6a-4973-b0b6-9eafd512d3f0","Type":"ContainerStarted","Data":"d0cffcdf95d96e383eb4ab03276bbe2881b1253f5af9765c86cfefe9e6a5c611"} Jul 28 13:44:13.640775 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:13.640736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sp6g4" event={"ID":"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9","Type":"ContainerStarted","Data":"02419fa94be5be66bc35eee474d00015de9f1a99f31461690e117bc5fe79df92"} Jul 28 13:44:13.641278 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:13.640823 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sp6g4" event={"ID":"dfcc0950-639c-40b6-8fdd-dfd780e0b6c9","Type":"ContainerStarted","Data":"3fe70a8e028709c8c9972eab98409d88d8985b0217d09942d64d1c577e902784"} Jul 28 13:44:13.658481 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:13.658138 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sp6g4" podStartSLOduration=66.756774935 podStartE2EDuration="1m8.658119211s" totalImagesPullingTime="1.901344276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:13.656607305 +0000 UTC m=+68.997902937" watchObservedRunningTime="2026-07-28 13:44:13.658119211 +0000 UTC m=+68.999414843" Jul 28 13:44:16.658133 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:16.658100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-df58h" event={"ID":"8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b","Type":"ContainerStarted","Data":"ea0072922dcfc0aecb7ae8282ae9a8334c21414220cd7485ae8497619e007e1a"} Jul 28 13:44:16.658591 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:16.658333 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:44:16.660858 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:16.660801 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfp42" event={"ID":"6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b","Type":"ContainerStarted","Data":"1e44a9a35c049a553821adec0242c83a29303661c8991066c6df434eeb65df31"} Jul 28 13:44:16.662236 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:16.662197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qns6w" event={"ID":"f03648b4-6f6a-4973-b0b6-9eafd512d3f0","Type":"ContainerStarted","Data":"90823a214d94e2da6af5602d866130248a0a91a8601d25ae2ce81f39fe1d5657"} Jul 28 13:44:16.681695 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:16.681649 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-df58h" podStartSLOduration=66.555589372 podStartE2EDuration="1m11.681631068s" totalImagesPullingTime="5.126041696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:16.67963703 +0000 UTC m=+72.020932662" watchObservedRunningTime="2026-07-28 13:44:16.681631068 +0000 UTC m=+72.022926701" Jul 28 13:44:16.702048 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:16.702002 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cfp42" podStartSLOduration=66.428714135 podStartE2EDuration="1m11.701986264s" totalImagesPullingTime="5.273272129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:16.700357538 +0000 UTC m=+72.041653171" watchObservedRunningTime="2026-07-28 13:44:16.701986264 +0000 UTC m=+72.043281897" Jul 28 13:44:17.667035 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:17.666997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qns6w" event={"ID":"f03648b4-6f6a-4973-b0b6-9eafd512d3f0","Type":"ContainerStarted","Data":"688eade1a0a77cea09f8b181df90428a4b96139c1c758e0d461c929820f341db"} Jul 28 13:44:17.687578 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:17.687531 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qns6w" podStartSLOduration=33.540651226 podStartE2EDuration="37.687518522s" totalImagesPullingTime="4.146867296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:17.687017808 +0000 UTC m=+73.028313441" watchObservedRunningTime="2026-07-28 13:44:17.687518522 +0000 UTC m=+73.028814182" Jul 28 13:44:18.447666 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.447635 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p"] Jul 28 13:44:18.449671 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.449652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.455676 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.455656 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 13:44:18.459790 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.459773 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 13:44:18.459874 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.459822 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 13:44:18.459999 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.459987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 13:44:18.474585 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.474565 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p"] Jul 28 13:44:18.585812 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.585783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66hhk\" (UniqueName: \"kubernetes.io/projected/55e91726-812c-49d1-b4af-73a93ec7d1c8-kube-api-access-66hhk\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.585939 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.585822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55e91726-812c-49d1-b4af-73a93ec7d1c8-tmp\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.585939 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.585852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55e91726-812c-49d1-b4af-73a93ec7d1c8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.670271 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.670248 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qns6w" Jul 28 13:44:18.686553 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.686529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55e91726-812c-49d1-b4af-73a93ec7d1c8-tmp\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.686648 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.686571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55e91726-812c-49d1-b4af-73a93ec7d1c8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.686648 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.686612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66hhk\" (UniqueName: \"kubernetes.io/projected/55e91726-812c-49d1-b4af-73a93ec7d1c8-kube-api-access-66hhk\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.686894 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.686876 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55e91726-812c-49d1-b4af-73a93ec7d1c8-tmp\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.689016 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.688997 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55e91726-812c-49d1-b4af-73a93ec7d1c8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.702153 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.702096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66hhk\" (UniqueName: \"kubernetes.io/projected/55e91726-812c-49d1-b4af-73a93ec7d1c8-kube-api-access-66hhk\") pod \"klusterlet-addon-workmgr-6c7cc998f-twv6p\" (UID: \"55e91726-812c-49d1-b4af-73a93ec7d1c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.758651 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.758627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:18.889416 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:18.889386 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p"] Jul 28 13:44:18.892127 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:18.892102 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e91726_812c_49d1_b4af_73a93ec7d1c8.slice/crio-3f7641042a8aa8d5b9ee253d5cc7a88110f9f72d62685c9cebe138e1aa7a6502 WatchSource:0}: Error finding container 3f7641042a8aa8d5b9ee253d5cc7a88110f9f72d62685c9cebe138e1aa7a6502: Status 404 returned error can't find the container with id 3f7641042a8aa8d5b9ee253d5cc7a88110f9f72d62685c9cebe138e1aa7a6502 Jul 28 13:44:19.389078 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:19.389047 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:44:19.389262 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:19.389098 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:44:19.389428 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:19.389414 2566 scope.go:117] "RemoveContainer" containerID="a577a80228554b67f8091522dfb25f3eaa1abc2bfaf0254e72bc7718e7131879" Jul 28 13:44:19.389595 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:19.389577 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-8h7js_openshift-console-operator(95e3939b-e7c0-4324-ba77-fe66ef6b1a0c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podUID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" Jul 28 13:44:19.673991 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:19.673914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" event={"ID":"55e91726-812c-49d1-b4af-73a93ec7d1c8","Type":"ContainerStarted","Data":"3f7641042a8aa8d5b9ee253d5cc7a88110f9f72d62685c9cebe138e1aa7a6502"} Jul 28 13:44:22.690330 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:22.690302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" event={"ID":"55e91726-812c-49d1-b4af-73a93ec7d1c8","Type":"ContainerStarted","Data":"1e79b1458a8f5c132d12dadcedab4287a6a17ca9cc2975365c3da0e733a6bc1d"} Jul 28 13:44:22.690641 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:22.690490 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:22.691963 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:22.691932 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" podUID="55e91726-812c-49d1-b4af-73a93ec7d1c8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.14:8000/readyz\": dial tcp 10.134.0.14:8000: connect: connection refused" Jul 28 13:44:22.710367 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:22.710291 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" podStartSLOduration=0.987673136 podStartE2EDuration="4.710274768s" totalImagesPullingTime="3.722601632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:22.708717497 +0000 UTC m=+78.050013133" watchObservedRunningTime="2026-07-28 13:44:22.710274768 +0000 UTC m=+78.051570401" Jul 28 13:44:23.695451 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:23.695422 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7cc998f-twv6p" Jul 28 13:44:24.449471 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.449444 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b"] Jul 28 13:44:24.451430 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.451414 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:24.454655 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.454634 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 13:44:24.454888 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.454873 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ln29w\"" Jul 28 13:44:24.469335 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.469313 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b"] Jul 28 13:44:24.532805 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.532776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6739ec7f-9342-4bbd-a806-9a868f6f408f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sk24b\" (UID: \"6739ec7f-9342-4bbd-a806-9a868f6f408f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:24.633340 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.633318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6739ec7f-9342-4bbd-a806-9a868f6f408f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sk24b\" (UID: \"6739ec7f-9342-4bbd-a806-9a868f6f408f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:24.633458 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.633355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:24.633520 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:24.633469 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 13:44:24.633571 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:24.633544 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6739ec7f-9342-4bbd-a806-9a868f6f408f-tls-certificates podName:6739ec7f-9342-4bbd-a806-9a868f6f408f nodeName:}" failed. No retries permitted until 2026-07-28 13:44:25.133524592 +0000 UTC m=+80.474820218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6739ec7f-9342-4bbd-a806-9a868f6f408f-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-sk24b" (UID: "6739ec7f-9342-4bbd-a806-9a868f6f408f") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 13:44:24.635480 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.635462 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf75689e-2bb4-456c-bd7b-9a7f4006e4df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4qn7\" (UID: \"bf75689e-2bb4-456c-bd7b-9a7f4006e4df\") " pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:24.903164 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.903087 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2kzl\"" Jul 28 13:44:24.911299 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:24.911280 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4qn7" Jul 28 13:44:25.041572 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.041544 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4qn7"] Jul 28 13:44:25.044701 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:25.044676 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf75689e_2bb4_456c_bd7b_9a7f4006e4df.slice/crio-7966a3f45e78e88008bf43650177c072db0356f958bfff8ae8889766a298baac WatchSource:0}: Error finding container 7966a3f45e78e88008bf43650177c072db0356f958bfff8ae8889766a298baac: Status 404 returned error can't find the container with id 7966a3f45e78e88008bf43650177c072db0356f958bfff8ae8889766a298baac Jul 28 13:44:25.138131 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.138109 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6739ec7f-9342-4bbd-a806-9a868f6f408f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sk24b\" (UID: \"6739ec7f-9342-4bbd-a806-9a868f6f408f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:25.140471 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.140447 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6739ec7f-9342-4bbd-a806-9a868f6f408f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sk24b\" (UID: \"6739ec7f-9342-4bbd-a806-9a868f6f408f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:25.359485 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.359453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:25.512459 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.512347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b"] Jul 28 13:44:25.516121 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:25.516088 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6739ec7f_9342_4bbd_a806_9a868f6f408f.slice/crio-a2af77008777c2719e6cb5593dd02c922c65c6f6399916e11395430e2719066a WatchSource:0}: Error finding container a2af77008777c2719e6cb5593dd02c922c65c6f6399916e11395430e2719066a: Status 404 returned error can't find the container with id a2af77008777c2719e6cb5593dd02c922c65c6f6399916e11395430e2719066a Jul 28 13:44:25.703847 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.703807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" event={"ID":"6739ec7f-9342-4bbd-a806-9a868f6f408f","Type":"ContainerStarted","Data":"a2af77008777c2719e6cb5593dd02c922c65c6f6399916e11395430e2719066a"} Jul 28 13:44:25.705390 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:25.705359 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4qn7" event={"ID":"bf75689e-2bb4-456c-bd7b-9a7f4006e4df","Type":"ContainerStarted","Data":"7966a3f45e78e88008bf43650177c072db0356f958bfff8ae8889766a298baac"} Jul 28 13:44:28.676196 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:28.676072 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qns6w" Jul 28 13:44:30.725477 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:30.725442 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" event={"ID":"6739ec7f-9342-4bbd-a806-9a868f6f408f","Type":"ContainerStarted","Data":"f0aee3b320f169a63c2a8412a6c0e9265b08d5e56737c4eb616b4c97e5f3f403"} Jul 28 13:44:30.725945 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:30.725504 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:30.727041 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:30.727015 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4qn7" event={"ID":"bf75689e-2bb4-456c-bd7b-9a7f4006e4df","Type":"ContainerStarted","Data":"5359d09c9c2e36fe156d971f9e2f19e144ba7ef7526feaeb6a296494901e4b2d"} Jul 28 13:44:30.730412 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:30.730394 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" Jul 28 13:44:30.742450 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:30.742402 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sk24b" podStartSLOduration=2.447807285 podStartE2EDuration="6.742388488s" totalImagesPullingTime="4.294581203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:30.741082901 +0000 UTC m=+86.082378533" watchObservedRunningTime="2026-07-28 13:44:30.742388488 +0000 UTC m=+86.083684121" Jul 28 13:44:31.191710 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.191678 2566 scope.go:117] "RemoveContainer" containerID="a577a80228554b67f8091522dfb25f3eaa1abc2bfaf0254e72bc7718e7131879" Jul 28 13:44:31.192243 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:31.191885 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-8h7js_openshift-console-operator(95e3939b-e7c0-4324-ba77-fe66ef6b1a0c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podUID="95e3939b-e7c0-4324-ba77-fe66ef6b1a0c" Jul 28 13:44:31.568092 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.568017 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pp66z"] Jul 28 13:44:31.571135 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.571114 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.574216 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.574195 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 13:44:31.574389 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.574205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 13:44:31.575056 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.574909 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 13:44:31.575155 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.575125 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kvf8j\"" Jul 28 13:44:31.575334 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.575307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 13:44:31.575445 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.575425 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 13:44:31.577077 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.577059 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pp66z"] Jul 28 13:44:31.686915 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.686884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f26baca8-6433-4bd9-90a2-eaaba3f05092-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.687073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.686923 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fgpg\" (UniqueName: \"kubernetes.io/projected/f26baca8-6433-4bd9-90a2-eaaba3f05092-kube-api-access-9fgpg\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.687073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.686972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f26baca8-6433-4bd9-90a2-eaaba3f05092-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.687073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.687040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26baca8-6433-4bd9-90a2-eaaba3f05092-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.787577 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.787536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26baca8-6433-4bd9-90a2-eaaba3f05092-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.788032 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.787586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f26baca8-6433-4bd9-90a2-eaaba3f05092-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.788032 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.787613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fgpg\" (UniqueName: \"kubernetes.io/projected/f26baca8-6433-4bd9-90a2-eaaba3f05092-kube-api-access-9fgpg\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.788032 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.787669 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f26baca8-6433-4bd9-90a2-eaaba3f05092-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.788370 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.788340 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26baca8-6433-4bd9-90a2-eaaba3f05092-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.790713 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.790670 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f26baca8-6433-4bd9-90a2-eaaba3f05092-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.790829 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.790718 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f26baca8-6433-4bd9-90a2-eaaba3f05092-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.797405 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.797385 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fgpg\" (UniqueName: \"kubernetes.io/projected/f26baca8-6433-4bd9-90a2-eaaba3f05092-kube-api-access-9fgpg\") pod \"prometheus-operator-84d69f794d-pp66z\" (UID: \"f26baca8-6433-4bd9-90a2-eaaba3f05092\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:31.883578 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:31.883507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" Jul 28 13:44:32.025558 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:32.025531 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pp66z"] Jul 28 13:44:32.028452 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:32.028426 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26baca8_6433_4bd9_90a2_eaaba3f05092.slice/crio-64f90ca97011fdd4bd36fb83def8b4968af6fddb496abb1ba2fe53151d32773d WatchSource:0}: Error finding container 64f90ca97011fdd4bd36fb83def8b4968af6fddb496abb1ba2fe53151d32773d: Status 404 returned error can't find the container with id 64f90ca97011fdd4bd36fb83def8b4968af6fddb496abb1ba2fe53151d32773d Jul 28 13:44:32.737151 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:32.737119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" event={"ID":"f26baca8-6433-4bd9-90a2-eaaba3f05092","Type":"ContainerStarted","Data":"64f90ca97011fdd4bd36fb83def8b4968af6fddb496abb1ba2fe53151d32773d"} Jul 28 13:44:34.745818 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:34.745785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4qn7" event={"ID":"bf75689e-2bb4-456c-bd7b-9a7f4006e4df","Type":"ContainerStarted","Data":"97d22b985ea98c203baff313c01e53471e78157e5854535bc568aa1dd0e9c5fe"} Jul 28 13:44:34.747511 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:34.747488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" event={"ID":"f26baca8-6433-4bd9-90a2-eaaba3f05092","Type":"ContainerStarted","Data":"0f7a0b85c200723d249ad9e444ffc21cda7fbc3160300ea8a1596e1a47dc58c0"} Jul 28 13:44:34.747641 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:34.747536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" event={"ID":"f26baca8-6433-4bd9-90a2-eaaba3f05092","Type":"ContainerStarted","Data":"cde35d74d92e131e657b5e4aa6de5039cfa5d92eb11063a9303947f798cc4505"} Jul 28 13:44:34.765114 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:34.765073 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-pp66z" podStartSLOduration=1.434559382 podStartE2EDuration="3.765056229s" totalImagesPullingTime="2.330496847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:34.764637179 +0000 UTC m=+90.105932825" watchObservedRunningTime="2026-07-28 13:44:34.765056229 +0000 UTC m=+90.106351863" Jul 28 13:44:37.140417 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.140384 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bvlgg"] Jul 28 13:44:37.154537 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.154512 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.157071 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.157046 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qbfrr\"" Jul 28 13:44:37.158483 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.158461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 13:44:37.158607 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.158461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 13:44:37.158607 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.158462 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 13:44:37.229137 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-wtmp\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229137 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c77w\" (UniqueName: \"kubernetes.io/projected/abdb99be-ba52-45b7-b670-3e498dcfeb1b-kube-api-access-2c77w\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229390 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229390 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229390 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-textfile\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229390 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abdb99be-ba52-45b7-b670-3e498dcfeb1b-metrics-client-ca\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229390 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-sys\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229619 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-tls\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.229619 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.229498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-root\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-tls\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-root\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-wtmp\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330235 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c77w\" (UniqueName: \"kubernetes.io/projected/abdb99be-ba52-45b7-b670-3e498dcfeb1b-kube-api-access-2c77w\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-textfile\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330366 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-root\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abdb99be-ba52-45b7-b670-3e498dcfeb1b-metrics-client-ca\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-sys\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:37.330473 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330480 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-wtmp\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.330472 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abdb99be-ba52-45b7-b670-3e498dcfeb1b-sys\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.330784 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:44:37.330533 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-tls podName:abdb99be-ba52-45b7-b670-3e498dcfeb1b nodeName:}" failed. No retries permitted until 2026-07-28 13:44:37.830512641 +0000 UTC m=+93.171808256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-tls") pod "node-exporter-bvlgg" (UID: "abdb99be-ba52-45b7-b670-3e498dcfeb1b") : secret "node-exporter-tls" not found Jul 28 13:44:37.331641 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.331099 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-textfile\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.331641 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.331111 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.331641 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.331504 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abdb99be-ba52-45b7-b670-3e498dcfeb1b-metrics-client-ca\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.333438 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.333412 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.339094 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.339071 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c77w\" (UniqueName: \"kubernetes.io/projected/abdb99be-ba52-45b7-b670-3e498dcfeb1b-kube-api-access-2c77w\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.835456 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.835410 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-tls\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:37.838027 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:37.837997 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abdb99be-ba52-45b7-b670-3e498dcfeb1b-node-exporter-tls\") pod \"node-exporter-bvlgg\" (UID: \"abdb99be-ba52-45b7-b670-3e498dcfeb1b\") " pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:38.066238 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.066201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvlgg" Jul 28 13:44:38.087523 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.087483 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:44:38.091914 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.091846 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.096146 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 13:44:38.096272 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096148 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 13:44:38.096272 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096189 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 13:44:38.096272 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096216 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w4bwv\"" Jul 28 13:44:38.096442 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096271 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 13:44:38.096442 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096133 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 13:44:38.096551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096468 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 13:44:38.096551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096531 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 13:44:38.096623 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096567 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 13:44:38.096623 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.096591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 13:44:38.106078 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:38.106057 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdb99be_ba52_45b7_b670_3e498dcfeb1b.slice/crio-504e4b0a18fe61889f44a019daca567a54ff66b32dc23200ea7ae6ece8db0f45 WatchSource:0}: Error finding container 504e4b0a18fe61889f44a019daca567a54ff66b32dc23200ea7ae6ece8db0f45: Status 404 returned error can't find the container with id 504e4b0a18fe61889f44a019daca567a54ff66b32dc23200ea7ae6ece8db0f45 Jul 28 13:44:38.110650 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.110633 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:44:38.240289 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240263 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-config-out\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240417 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-web-config\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-config-volume\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240593 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks74t\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-kube-api-access-ks74t\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.240978 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.240642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-tls-assets\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341750 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341750 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341750 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-config-out\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-web-config\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-config-volume\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.341979 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.342359 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.341994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.342359 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.342023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks74t\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-kube-api-access-ks74t\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.342359 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.342058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-tls-assets\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.342664 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.342641 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.342930 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.342907 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.342930 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.342921 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.344659 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.344614 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-tls-assets\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.344800 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.344775 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-config-out\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.344901 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.344884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.345236 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.345187 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-web-config\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.345788 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.345762 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.345866 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.345787 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.345866 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.345786 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.345934 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.345912 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.346382 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.346368 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-config-volume\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.352330 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.352309 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks74t\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-kube-api-access-ks74t\") pod \"alertmanager-main-0\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.404335 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.404308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:44:38.538034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.538002 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:44:38.541867 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:38.541841 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabec430a_cbba_46f1_b055_a05f40460178.slice/crio-17cdad53c5ae7880f4e8d52f20eb5e020725ec6b1770c67ca5d005ad102dcb92 WatchSource:0}: Error finding container 17cdad53c5ae7880f4e8d52f20eb5e020725ec6b1770c67ca5d005ad102dcb92: Status 404 returned error can't find the container with id 17cdad53c5ae7880f4e8d52f20eb5e020725ec6b1770c67ca5d005ad102dcb92 Jul 28 13:44:38.764417 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.764376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"17cdad53c5ae7880f4e8d52f20eb5e020725ec6b1770c67ca5d005ad102dcb92"} Jul 28 13:44:38.765871 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.765838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvlgg" event={"ID":"abdb99be-ba52-45b7-b670-3e498dcfeb1b","Type":"ContainerStarted","Data":"504e4b0a18fe61889f44a019daca567a54ff66b32dc23200ea7ae6ece8db0f45"} Jul 28 13:44:38.768189 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:38.768164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4qn7" event={"ID":"bf75689e-2bb4-456c-bd7b-9a7f4006e4df","Type":"ContainerStarted","Data":"2bb622ed647f85a18c2e509e66d0304a577881765811a75dfd8e8f25c65d1b63"} Jul 28 13:44:39.774130 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:39.774104 2566 generic.go:356] "Generic (PLEG): container finished" podID="abdb99be-ba52-45b7-b670-3e498dcfeb1b" containerID="f26b6f02b659f2952461503fbd5ef0f323afd3cf956a90d5a803fba8ea45e19d" exitCode=0 Jul 28 13:44:39.774522 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:39.774138 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvlgg" event={"ID":"abdb99be-ba52-45b7-b670-3e498dcfeb1b","Type":"ContainerDied","Data":"f26b6f02b659f2952461503fbd5ef0f323afd3cf956a90d5a803fba8ea45e19d"} Jul 28 13:44:39.800863 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:39.800814 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w4qn7" podStartSLOduration=34.850300834 podStartE2EDuration="47.800794966s" totalImagesPullingTime="12.950494132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:38.793425786 +0000 UTC m=+94.134721418" watchObservedRunningTime="2026-07-28 13:44:39.800794966 +0000 UTC m=+95.142090600" Jul 28 13:44:40.101748 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.101675 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84d4cf7465-fjf9v"] Jul 28 13:44:40.106097 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.106067 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.109249 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.109210 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 13:44:40.111812 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.111791 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 13:44:40.112568 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.112547 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 13:44:40.112708 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.112684 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 13:44:40.112906 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.112892 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 13:44:40.113594 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.113577 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bi5a3ugc29239\"" Jul 28 13:44:40.118749 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.118725 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7bj4r\"" Jul 28 13:44:40.184116 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.184083 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d4cf7465-fjf9v"] Jul 28 13:44:40.258340 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258466 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258466 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-tls\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258466 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258567 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-metrics-client-ca\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258567 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-grpc-tls\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258567 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wl6\" (UniqueName: \"kubernetes.io/projected/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-kube-api-access-k9wl6\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.258567 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.258564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359619 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359619 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-tls\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359635 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-metrics-client-ca\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-grpc-tls\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wl6\" (UniqueName: \"kubernetes.io/projected/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-kube-api-access-k9wl6\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.359791 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.359790 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.360529 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.360500 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-metrics-client-ca\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.362528 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.362468 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.362528 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.362493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.362681 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.362608 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.362740 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.362721 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.362818 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.362784 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-thanos-querier-tls\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.362853 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.362839 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-secret-grpc-tls\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.368336 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.368319 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wl6\" (UniqueName: \"kubernetes.io/projected/4dcdc800-de69-45f9-b532-1d51f5fcc2ab-kube-api-access-k9wl6\") pod \"thanos-querier-84d4cf7465-fjf9v\" (UID: \"4dcdc800-de69-45f9-b532-1d51f5fcc2ab\") " pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.415360 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.415332 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:40.548087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.548059 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d4cf7465-fjf9v"] Jul 28 13:44:40.550421 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:40.550396 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcdc800_de69_45f9_b532_1d51f5fcc2ab.slice/crio-4ba8d353a5045861718e29f787aac6b7cde255dd042b42e9d511ec5ee36f1c6c WatchSource:0}: Error finding container 4ba8d353a5045861718e29f787aac6b7cde255dd042b42e9d511ec5ee36f1c6c: Status 404 returned error can't find the container with id 4ba8d353a5045861718e29f787aac6b7cde255dd042b42e9d511ec5ee36f1c6c Jul 28 13:44:40.782632 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.782603 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc" exitCode=0 Jul 28 13:44:40.783061 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.782680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc"} Jul 28 13:44:40.784862 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.784836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvlgg" event={"ID":"abdb99be-ba52-45b7-b670-3e498dcfeb1b","Type":"ContainerStarted","Data":"97d33e18684c565e792b1c4ce9aa30b57d9a4bdce047a898ea931959fc2f5227"} Jul 28 13:44:40.784994 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.784885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvlgg" event={"ID":"abdb99be-ba52-45b7-b670-3e498dcfeb1b","Type":"ContainerStarted","Data":"9b49fd1f510eac9c3eecc1d2489ca35cadd306b305ed2a389e7dc5a10cb5237b"} Jul 28 13:44:40.786070 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.786047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"4ba8d353a5045861718e29f787aac6b7cde255dd042b42e9d511ec5ee36f1c6c"} Jul 28 13:44:40.841251 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:40.841192 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bvlgg" podStartSLOduration=2.850573723 podStartE2EDuration="3.84117825s" totalImagesPullingTime="928.267625ms" totalInitContainerRuntime="62.336902ms" isStatefulPod=true podCreationTimestamp="2026-07-28 13:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:40.840310265 +0000 UTC m=+96.181605904" watchObservedRunningTime="2026-07-28 13:44:40.84117825 +0000 UTC m=+96.182473911" Jul 28 13:44:41.514245 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.514198 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c8bf597bc-w8w97"] Jul 28 13:44:41.517707 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.517683 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.520199 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.520173 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 13:44:41.521144 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.521124 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2696s5h0u5qv6\"" Jul 28 13:44:41.521276 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.521252 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wdpzf\"" Jul 28 13:44:41.521352 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.521304 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 13:44:41.521410 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.521362 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 13:44:41.521515 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.521449 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 13:44:41.535763 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.535742 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c8bf597bc-w8w97"] Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-secret-metrics-server-tls\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-client-ca-bundle\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbc9e36f-7521-4567-8a16-20b41deaad42-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsnw\" (UniqueName: \"kubernetes.io/projected/bbc9e36f-7521-4567-8a16-20b41deaad42-kube-api-access-ldsnw\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-secret-metrics-server-client-certs\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bbc9e36f-7521-4567-8a16-20b41deaad42-metrics-server-audit-profiles\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.672059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.671615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bbc9e36f-7521-4567-8a16-20b41deaad42-audit-log\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.772936 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.772845 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-secret-metrics-server-tls\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.772936 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.772899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-client-ca-bundle\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.773154 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.772945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbc9e36f-7521-4567-8a16-20b41deaad42-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.773154 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.772987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsnw\" (UniqueName: \"kubernetes.io/projected/bbc9e36f-7521-4567-8a16-20b41deaad42-kube-api-access-ldsnw\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.773154 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.773042 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-secret-metrics-server-client-certs\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.773154 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.773074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bbc9e36f-7521-4567-8a16-20b41deaad42-metrics-server-audit-profiles\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.773385 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.773285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bbc9e36f-7521-4567-8a16-20b41deaad42-audit-log\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.773789 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.773764 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bbc9e36f-7521-4567-8a16-20b41deaad42-audit-log\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.774127 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.774105 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbc9e36f-7521-4567-8a16-20b41deaad42-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.774446 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.774415 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bbc9e36f-7521-4567-8a16-20b41deaad42-metrics-server-audit-profiles\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.775718 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.775690 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-secret-metrics-server-tls\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.776022 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.776001 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-secret-metrics-server-client-certs\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.776203 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.776182 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc9e36f-7521-4567-8a16-20b41deaad42-client-ca-bundle\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.782561 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.782536 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsnw\" (UniqueName: \"kubernetes.io/projected/bbc9e36f-7521-4567-8a16-20b41deaad42-kube-api-access-ldsnw\") pod \"metrics-server-6c8bf597bc-w8w97\" (UID: \"bbc9e36f-7521-4567-8a16-20b41deaad42\") " pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.829110 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.829058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:44:41.982206 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:41.982166 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c8bf597bc-w8w97"] Jul 28 13:44:41.985576 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:41.985544 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc9e36f_7521_4567_8a16_20b41deaad42.slice/crio-c1183fd45abc4aedc44bec4eb394b3754280a067c15edaa97acec40b092153d5 WatchSource:0}: Error finding container c1183fd45abc4aedc44bec4eb394b3754280a067c15edaa97acec40b092153d5: Status 404 returned error can't find the container with id c1183fd45abc4aedc44bec4eb394b3754280a067c15edaa97acec40b092153d5 Jul 28 13:44:42.795421 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:42.795380 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" event={"ID":"bbc9e36f-7521-4567-8a16-20b41deaad42","Type":"ContainerStarted","Data":"c1183fd45abc4aedc44bec4eb394b3754280a067c15edaa97acec40b092153d5"} Jul 28 13:44:43.191969 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.191929 2566 scope.go:117] "RemoveContainer" containerID="a577a80228554b67f8091522dfb25f3eaa1abc2bfaf0254e72bc7718e7131879" Jul 28 13:44:43.374112 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.372921 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:44:43.378623 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.377044 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.379664 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.379642 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 13:44:43.379786 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.379704 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 13:44:43.381380 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381361 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-409eajdjadthe\"" Jul 28 13:44:43.381526 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381411 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nz744\"" Jul 28 13:44:43.381594 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 13:44:43.381654 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381608 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 13:44:43.382013 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381784 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 13:44:43.382013 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381789 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 13:44:43.382013 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381840 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 13:44:43.382013 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.381794 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 13:44:43.382281 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.382140 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 13:44:43.382603 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.382329 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 13:44:43.382603 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.382410 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 13:44:43.385377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.384442 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 13:44:43.385874 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.385723 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 13:44:43.387699 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.387521 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 13:44:43.398482 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.397818 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:44:43.489757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.489931 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.489931 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.489931 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.489931 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490127 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490127 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.489991 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-config\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490127 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490127 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490127 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-config-out\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490256 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-web-config\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490377 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4djv\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-kube-api-access-n4djv\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490649 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490649 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.490649 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.490490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.591975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592361 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-config\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592964 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592964 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.592964 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.592439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.593114 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.593014 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.593114 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.593040 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.593728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.593910 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.593955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-config-out\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.594002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.594030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.594056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594087 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.594091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594533 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.594127 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-web-config\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.594533 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.594152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4djv\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-kube-api-access-n4djv\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.595324 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.595262 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.595707 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.595683 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.596338 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.596312 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.596435 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.596382 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.599570 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.599035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-config\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602318 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.601839 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602318 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.601923 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602318 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.601939 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602318 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.602150 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-config-out\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602318 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.602282 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602608 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.602399 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.602608 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.602586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.603113 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.603051 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.603734 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.603683 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.604648 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.604618 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4djv\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-kube-api-access-n4djv\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.605027 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.605008 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-web-config\") pod \"prometheus-k8s-0\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.691812 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.691784 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:43.804556 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.804517 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"fdbc900623e2766475ecc3f0ddfb717699a286017cca1ac3072c95630c650cac"} Jul 28 13:44:43.804717 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.804599 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"10d44e645a25a910608c85e8f3721c8bc3c921ccafbc481c52f259d26cbf6161"} Jul 28 13:44:43.804717 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.804639 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"70f51d02434f1a98b59f9bf6c0e8b6219f7ee296b1d3a98ea81b28de337887d2"} Jul 28 13:44:43.808577 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.808543 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:44:43.808712 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.808669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" event={"ID":"95e3939b-e7c0-4324-ba77-fe66ef6b1a0c","Type":"ContainerStarted","Data":"b060ce155c763fed37eccb7bc46eafd6d34520e24d24d5ce171384ebcf6f58d7"} Jul 28 13:44:43.809167 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.809055 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:44:43.812408 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.812380 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583"} Jul 28 13:44:43.812524 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.812458 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6"} Jul 28 13:44:43.812524 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.812512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e"} Jul 28 13:44:43.812628 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.812548 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1"} Jul 28 13:44:43.812628 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.812573 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6"} Jul 28 13:44:43.833161 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:43.833105 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" podStartSLOduration=51.08072535 podStartE2EDuration="54.833086956s" totalImagesPullingTime="3.752361606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:43.83025614 +0000 UTC m=+99.171551774" watchObservedRunningTime="2026-07-28 13:44:43.833086956 +0000 UTC m=+99.174382587" Jul 28 13:44:44.254534 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.254487 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:44:44.256569 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:44:44.256533 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31065774_1264_4ce9_ae5b_44cec497f37c.slice/crio-841a5dd553467790b5f972d66c88f120aff7d9930296829d1486260023896062 WatchSource:0}: Error finding container 841a5dd553467790b5f972d66c88f120aff7d9930296829d1486260023896062: Status 404 returned error can't find the container with id 841a5dd553467790b5f972d66c88f120aff7d9930296829d1486260023896062 Jul 28 13:44:44.501595 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.501296 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-8h7js" Jul 28 13:44:44.820596 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.820497 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="fe7834ed66b5e100026e2fcace55dad72d2a98b0fae0f883f4549e28fd8c3ead" exitCode=0 Jul 28 13:44:44.820713 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.820585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"fe7834ed66b5e100026e2fcace55dad72d2a98b0fae0f883f4549e28fd8c3ead"} Jul 28 13:44:44.820713 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.820675 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"841a5dd553467790b5f972d66c88f120aff7d9930296829d1486260023896062"} Jul 28 13:44:44.823252 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.823205 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"8197cbfbd657bcfcddc8afcf1121ccd991bc0f88b3dc4a5d9372d822d345439c"} Jul 28 13:44:44.824864 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.824833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" event={"ID":"bbc9e36f-7521-4567-8a16-20b41deaad42","Type":"ContainerStarted","Data":"6caa45e65470d07ce5b3bf09fdfa805f667a833c83736fb87d795bf0996871cc"} Jul 28 13:44:44.828481 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.828461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerStarted","Data":"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc"} Jul 28 13:44:44.887772 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.887712 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.144447383 podStartE2EDuration="6.88769158s" totalImagesPullingTime="4.728169253s" totalInitContainerRuntime="15.074944ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:44.885719921 +0000 UTC m=+100.227015556" watchObservedRunningTime="2026-07-28 13:44:44.88769158 +0000 UTC m=+100.228987215" Jul 28 13:44:44.910813 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:44.910761 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" podStartSLOduration=1.7360067479999999 podStartE2EDuration="3.910739122s" totalImagesPullingTime="2.174732374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:44.909002179 +0000 UTC m=+100.250297815" watchObservedRunningTime="2026-07-28 13:44:44.910739122 +0000 UTC m=+100.252034755" Jul 28 13:44:45.837322 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:45.837162 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"f0cb8897929ce9c90573534a0d035c6ca36d69c3ac1983f0bd3b6fc339137ec9"} Jul 28 13:44:45.837322 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:45.837307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" event={"ID":"4dcdc800-de69-45f9-b532-1d51f5fcc2ab","Type":"ContainerStarted","Data":"d82335db1362f7c297468f05c3635757f7eb829c00d69c1cb41c5f81f559a54a"} Jul 28 13:44:45.837817 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:45.837511 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:45.861929 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:45.861324 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" podStartSLOduration=1.950939113 podStartE2EDuration="5.861307511s" totalImagesPullingTime="3.910368398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:45.86099712 +0000 UTC m=+101.202292795" watchObservedRunningTime="2026-07-28 13:44:45.861307511 +0000 UTC m=+101.202603147" Jul 28 13:44:47.670107 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:47.670074 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-df58h" Jul 28 13:44:48.851686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:48.851600 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"df0edaafab38edaeb48f83ba906720e2eb93bff2166883cd40c1cff4a0ae9df9"} Jul 28 13:44:48.851686 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:48.851686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"ed54ffe46eb7fce0b122417a516dcdbc637ce3d2b11a457dbc2b0367ff58757f"} Jul 28 13:44:48.852082 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:48.851714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"499009ed36f98402756f970239570292baff6e363b905f86ea6efd2a1415144d"} Jul 28 13:44:48.852082 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:48.851739 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"7f5786ad9fbf241626625d0e818853259ebdf4b74a181636894be92766f4b034"} Jul 28 13:44:48.852082 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:48.851768 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"fa3f83521e85cff1c7c686d325e05808bf7f28f667dc428abffb3a33635f6589"} Jul 28 13:44:48.852082 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:48.851804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerStarted","Data":"08bf5813d0593bb0034fa1786c7a929f59a5fbcc579678935a827062c7b7a664"} Jul 28 13:44:51.848711 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:51.848682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84d4cf7465-fjf9v" Jul 28 13:44:51.901808 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:51.901755 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.794780064 podStartE2EDuration="8.901723912s" totalImagesPullingTime="3.079942718s" totalInitContainerRuntime="27.00113ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:48.889157749 +0000 UTC m=+104.230453395" watchObservedRunningTime="2026-07-28 13:44:51.901723912 +0000 UTC m=+107.243019547" Jul 28 13:44:53.692995 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:53.692961 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:44:57.888105 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:57.888070 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e7cb077-c80f-43b8-a75e-951f88654519" containerID="6b18dd41f98144d3ba9f52f286fffa3e4e5283dde2843661bc43cfff076090d1" exitCode=0 Jul 28 13:44:57.888466 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:57.888141 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" event={"ID":"3e7cb077-c80f-43b8-a75e-951f88654519","Type":"ContainerDied","Data":"6b18dd41f98144d3ba9f52f286fffa3e4e5283dde2843661bc43cfff076090d1"} Jul 28 13:44:57.888466 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:57.888444 2566 scope.go:117] "RemoveContainer" containerID="6b18dd41f98144d3ba9f52f286fffa3e4e5283dde2843661bc43cfff076090d1" Jul 28 13:44:58.893771 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:44:58.893736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x" event={"ID":"3e7cb077-c80f-43b8-a75e-951f88654519","Type":"ContainerStarted","Data":"f04403049248df1a899be2207c79c69b87551c020c36d28d32738ea80fa4dbf9"} Jul 28 13:45:01.829914 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:01.829878 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:45:01.830335 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:01.829939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:45:21.835379 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:21.835348 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:45:21.839047 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:21.838978 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c8bf597bc-w8w97" Jul 28 13:45:43.693023 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:43.692988 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:45:43.708683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:43.708658 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:45:44.093452 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:44.093375 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:45:57.547307 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547123 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:45:57.547827 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547464 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="alertmanager" containerID="cri-o://6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6" gracePeriod=120 Jul 28 13:45:57.547827 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547474 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-metric" containerID="cri-o://0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583" gracePeriod=120 Jul 28 13:45:57.547827 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547543 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-web" containerID="cri-o://af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e" gracePeriod=120 Jul 28 13:45:57.547827 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547598 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="config-reloader" containerID="cri-o://133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1" gracePeriod=120 Jul 28 13:45:57.547827 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547572 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="prom-label-proxy" containerID="cri-o://312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc" gracePeriod=120 Jul 28 13:45:57.547827 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:57.547689 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy" containerID="cri-o://8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6" gracePeriod=120 Jul 28 13:45:58.135101 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135067 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc" exitCode=0 Jul 28 13:45:58.135101 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135095 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6" exitCode=0 Jul 28 13:45:58.135101 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135102 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1" exitCode=0 Jul 28 13:45:58.135101 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135108 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6" exitCode=0 Jul 28 13:45:58.135380 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc"} Jul 28 13:45:58.135380 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135195 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6"} Jul 28 13:45:58.135380 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1"} Jul 28 13:45:58.135380 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.135264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6"} Jul 28 13:45:58.798737 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.798705 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:58.913868 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913791 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-tls-assets\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.913868 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913828 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-main-tls\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.913868 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913852 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913889 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-metric\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913909 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-metrics-client-ca\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913927 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-config-volume\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913948 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks74t\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-kube-api-access-ks74t\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.913984 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-trusted-ca-bundle\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914008 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-cluster-tls-config\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914072 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-web-config\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914101 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-main-db\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914136 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-web\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914257 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914170 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-config-out\") pod \"abec430a-cbba-46f1-b055-a05f40460178\" (UID: \"abec430a-cbba-46f1-b055-a05f40460178\") " Jul 28 13:45:58.914747 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914438 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:45:58.914747 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.914600 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:45:58.915200 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.915169 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:45:58.916634 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.916600 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:58.917503 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.917169 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:45:58.917503 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.917277 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-config-volume" (OuterVolumeSpecName: "config-volume") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:58.917656 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.917605 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-config-out" (OuterVolumeSpecName: "config-out") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:45:58.917656 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.917611 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:58.917810 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.917786 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:58.918120 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.918096 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:58.918430 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.918403 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-kube-api-access-ks74t" (OuterVolumeSpecName: "kube-api-access-ks74t") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "kube-api-access-ks74t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:45:58.922005 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.921896 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:58.928107 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:58.928087 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-web-config" (OuterVolumeSpecName: "web-config") pod "abec430a-cbba-46f1-b055-a05f40460178" (UID: "abec430a-cbba-46f1-b055-a05f40460178"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:59.015481 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015455 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015481 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015481 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-cluster-tls-config\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015496 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-web-config\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015509 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-alertmanager-main-db\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015523 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015535 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abec430a-cbba-46f1-b055-a05f40460178-config-out\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015548 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-tls-assets\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015561 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-main-tls\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015574 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015588 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015603 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abec430a-cbba-46f1-b055-a05f40460178-metrics-client-ca\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015616 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/abec430a-cbba-46f1-b055-a05f40460178-config-volume\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.015637 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.015629 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks74t\" (UniqueName: \"kubernetes.io/projected/abec430a-cbba-46f1-b055-a05f40460178-kube-api-access-ks74t\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:45:59.142622 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142591 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583" exitCode=0 Jul 28 13:45:59.142622 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142614 2566 generic.go:356] "Generic (PLEG): container finished" podID="abec430a-cbba-46f1-b055-a05f40460178" containerID="af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e" exitCode=0 Jul 28 13:45:59.142825 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142669 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.142825 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142678 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583"} Jul 28 13:45:59.142825 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142794 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e"} Jul 28 13:45:59.142961 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"abec430a-cbba-46f1-b055-a05f40460178","Type":"ContainerDied","Data":"17cdad53c5ae7880f4e8d52f20eb5e020725ec6b1770c67ca5d005ad102dcb92"} Jul 28 13:45:59.142961 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.142857 2566 scope.go:117] "RemoveContainer" containerID="312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc" Jul 28 13:45:59.152335 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.152237 2566 scope.go:117] "RemoveContainer" containerID="0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583" Jul 28 13:45:59.161208 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.161194 2566 scope.go:117] "RemoveContainer" containerID="8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6" Jul 28 13:45:59.167833 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.167805 2566 scope.go:117] "RemoveContainer" containerID="af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e" Jul 28 13:45:59.173566 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.173536 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:45:59.175059 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.175038 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:45:59.176049 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.176034 2566 scope.go:117] "RemoveContainer" containerID="133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1" Jul 28 13:45:59.182687 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.182672 2566 scope.go:117] "RemoveContainer" containerID="6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6" Jul 28 13:45:59.189508 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.189492 2566 scope.go:117] "RemoveContainer" containerID="f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc" Jul 28 13:45:59.196862 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.196839 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abec430a-cbba-46f1-b055-a05f40460178" path="/var/lib/kubelet/pods/abec430a-cbba-46f1-b055-a05f40460178/volumes" Jul 28 13:45:59.197294 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.197276 2566 scope.go:117] "RemoveContainer" containerID="312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc" Jul 28 13:45:59.197534 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.197511 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc\": container with ID starting with 312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc not found: ID does not exist" containerID="312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc" Jul 28 13:45:59.197606 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.197545 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc"} err="failed to get container status \"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc\": rpc error: code = NotFound desc = could not find container \"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc\": container with ID starting with 312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc not found: ID does not exist" Jul 28 13:45:59.197606 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.197584 2566 scope.go:117] "RemoveContainer" containerID="0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583" Jul 28 13:45:59.197857 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.197841 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583\": container with ID starting with 0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583 not found: ID does not exist" containerID="0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583" Jul 28 13:45:59.197896 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.197863 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583"} err="failed to get container status \"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583\": rpc error: code = NotFound desc = could not find container \"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583\": container with ID starting with 0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583 not found: ID does not exist" Jul 28 13:45:59.197896 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.197880 2566 scope.go:117] "RemoveContainer" containerID="8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6" Jul 28 13:45:59.198098 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.198081 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6\": container with ID starting with 8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6 not found: ID does not exist" containerID="8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6" Jul 28 13:45:59.198161 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198105 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6"} err="failed to get container status \"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6\": rpc error: code = NotFound desc = could not find container \"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6\": container with ID starting with 8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6 not found: ID does not exist" Jul 28 13:45:59.198161 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198125 2566 scope.go:117] "RemoveContainer" containerID="af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e" Jul 28 13:45:59.198378 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.198362 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e\": container with ID starting with af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e not found: ID does not exist" containerID="af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e" Jul 28 13:45:59.198422 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198383 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e"} err="failed to get container status \"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e\": rpc error: code = NotFound desc = could not find container \"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e\": container with ID starting with af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e not found: ID does not exist" Jul 28 13:45:59.198422 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198404 2566 scope.go:117] "RemoveContainer" containerID="133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1" Jul 28 13:45:59.198636 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.198619 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1\": container with ID starting with 133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1 not found: ID does not exist" containerID="133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1" Jul 28 13:45:59.198704 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198640 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1"} err="failed to get container status \"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1\": rpc error: code = NotFound desc = could not find container \"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1\": container with ID starting with 133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1 not found: ID does not exist" Jul 28 13:45:59.198704 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198658 2566 scope.go:117] "RemoveContainer" containerID="6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6" Jul 28 13:45:59.198892 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.198875 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6\": container with ID starting with 6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6 not found: ID does not exist" containerID="6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6" Jul 28 13:45:59.198945 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198900 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6"} err="failed to get container status \"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6\": rpc error: code = NotFound desc = could not find container \"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6\": container with ID starting with 6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6 not found: ID does not exist" Jul 28 13:45:59.198945 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.198914 2566 scope.go:117] "RemoveContainer" containerID="f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc" Jul 28 13:45:59.199109 ip-10-0-130-220 kubenswrapper[2566]: E0728 13:45:59.199094 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc\": container with ID starting with f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc not found: ID does not exist" containerID="f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc" Jul 28 13:45:59.199152 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199112 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc"} err="failed to get container status \"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc\": rpc error: code = NotFound desc = could not find container \"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc\": container with ID starting with f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc not found: ID does not exist" Jul 28 13:45:59.199152 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199128 2566 scope.go:117] "RemoveContainer" containerID="312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc" Jul 28 13:45:59.199384 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199358 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc"} err="failed to get container status \"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc\": rpc error: code = NotFound desc = could not find container \"312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc\": container with ID starting with 312fd777cc0dac7e481b433a7b90bf8e8158ed19af2ec5e1a81f28e518fa1abc not found: ID does not exist" Jul 28 13:45:59.199461 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199386 2566 scope.go:117] "RemoveContainer" containerID="0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583" Jul 28 13:45:59.199642 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199625 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583"} err="failed to get container status \"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583\": rpc error: code = NotFound desc = could not find container \"0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583\": container with ID starting with 0dd475d36660b67dcc21dba997b2c66c25638f60437cad586eaf6bc6e4663583 not found: ID does not exist" Jul 28 13:45:59.199707 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199643 2566 scope.go:117] "RemoveContainer" containerID="8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6" Jul 28 13:45:59.199837 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199821 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6"} err="failed to get container status \"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6\": rpc error: code = NotFound desc = could not find container \"8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6\": container with ID starting with 8c0c2379200a8213bff6028b3aa5274c579013a524e8928ffedc6d0d3bfe1ec6 not found: ID does not exist" Jul 28 13:45:59.199883 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199837 2566 scope.go:117] "RemoveContainer" containerID="af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e" Jul 28 13:45:59.200006 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.199991 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e"} err="failed to get container status \"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e\": rpc error: code = NotFound desc = could not find container \"af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e\": container with ID starting with af29e94fc909d0e8157fdb9ca99baf19dcb57c66a20a66d227d3d57990697e7e not found: ID does not exist" Jul 28 13:45:59.200045 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.200007 2566 scope.go:117] "RemoveContainer" containerID="133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1" Jul 28 13:45:59.200205 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.200190 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1"} err="failed to get container status \"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1\": rpc error: code = NotFound desc = could not find container \"133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1\": container with ID starting with 133c443f6455b7665f563e07235d46a1410eb7e5b0eb4cc24a6875a509e94ea1 not found: ID does not exist" Jul 28 13:45:59.200279 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.200206 2566 scope.go:117] "RemoveContainer" containerID="6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6" Jul 28 13:45:59.200456 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.200438 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6"} err="failed to get container status \"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6\": rpc error: code = NotFound desc = could not find container \"6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6\": container with ID starting with 6e0d9ca9af3716fe11c1d38579a43a9bc32abb486da99147159ba4fe0212cce6 not found: ID does not exist" Jul 28 13:45:59.200456 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.200456 2566 scope.go:117] "RemoveContainer" containerID="f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc" Jul 28 13:45:59.200690 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.200667 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc"} err="failed to get container status \"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc\": rpc error: code = NotFound desc = could not find container \"f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc\": container with ID starting with f4f9f6f71987aaef29cfce821ab7f81f18571c9a958f8aea9e68ff7929c6cacc not found: ID does not exist" Jul 28 13:45:59.210716 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.210694 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:45:59.210995 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.210983 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="config-reloader" Jul 28 13:45:59.211037 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.210997 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="config-reloader" Jul 28 13:45:59.211037 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211008 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy" Jul 28 13:45:59.211037 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211014 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy" Jul 28 13:45:59.211037 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211021 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="init-config-reloader" Jul 28 13:45:59.211037 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211031 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="init-config-reloader" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211040 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-metric" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211046 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-metric" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211054 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="alertmanager" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211059 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="alertmanager" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211067 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="prom-label-proxy" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211071 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="prom-label-proxy" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211081 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-web" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211086 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-web" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211138 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-metric" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211147 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="config-reloader" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211153 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="prom-label-proxy" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211160 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="alertmanager" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211166 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy-web" Jul 28 13:45:59.211182 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.211171 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abec430a-cbba-46f1-b055-a05f40460178" containerName="kube-rbac-proxy" Jul 28 13:45:59.214737 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.214722 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.218950 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.218927 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 13:45:59.218950 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.218941 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 13:45:59.219279 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.218958 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 13:45:59.219406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.219386 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w4bwv\"" Jul 28 13:45:59.219406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.219400 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 13:45:59.219547 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.219431 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 13:45:59.219547 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.219458 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 13:45:59.219706 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.219691 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 13:45:59.220146 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.220132 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 13:45:59.227312 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.227296 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 13:45:59.232471 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.232448 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:45:59.319727 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-web-config\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.319727 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.319942 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.319942 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.319942 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.319991 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320073 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.320040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320165 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.320110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gflds\" (UniqueName: \"kubernetes.io/projected/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-kube-api-access-gflds\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320165 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.320142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320249 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.320188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320288 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.320255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.320321 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.320290 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-config-out\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421346 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421283 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-web-config\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421346 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421346 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421475 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421531 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gflds\" (UniqueName: \"kubernetes.io/projected/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-kube-api-access-gflds\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421850 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421850 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421850 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.421850 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.421644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-config-out\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.422189 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.422143 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.422386 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.422363 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.423014 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.422985 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.424267 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.424244 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-config-out\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.424557 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.424535 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.424629 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.424598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.424746 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.424724 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.424853 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.424823 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.425034 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.425012 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.425101 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.425044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.425157 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.425134 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.426293 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.426269 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-web-config\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.434741 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.434715 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gflds\" (UniqueName: \"kubernetes.io/projected/d837adf5-f113-4c72-98c1-b7cf3eb0d67d-kube-api-access-gflds\") pod \"alertmanager-main-0\" (UID: \"d837adf5-f113-4c72-98c1-b7cf3eb0d67d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.525121 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.525098 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:45:59.672364 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:45:59.672285 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:45:59.675146 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:45:59.675116 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd837adf5_f113_4c72_98c1_b7cf3eb0d67d.slice/crio-4999bc66e616b465ead67f3db63de59f0f8ea1ee219f70741d9305236d4da3b5 WatchSource:0}: Error finding container 4999bc66e616b465ead67f3db63de59f0f8ea1ee219f70741d9305236d4da3b5: Status 404 returned error can't find the container with id 4999bc66e616b465ead67f3db63de59f0f8ea1ee219f70741d9305236d4da3b5 Jul 28 13:46:00.148104 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:00.148071 2566 generic.go:356] "Generic (PLEG): container finished" podID="d837adf5-f113-4c72-98c1-b7cf3eb0d67d" containerID="e03ce626aa81cf0552d0e001e7c7ebaf0e54a255f1f827cbb9cac001d0206ac0" exitCode=0 Jul 28 13:46:00.148490 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:00.148159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerDied","Data":"e03ce626aa81cf0552d0e001e7c7ebaf0e54a255f1f827cbb9cac001d0206ac0"} Jul 28 13:46:00.148490 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:00.148238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"4999bc66e616b465ead67f3db63de59f0f8ea1ee219f70741d9305236d4da3b5"} Jul 28 13:46:01.155519 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.155488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"acbc10ed5fb0c9cef85a5fd3dd75886f5384fca1c3ad0a1f3fd4e34586b8894e"} Jul 28 13:46:01.155923 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.155548 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"d83ab1ee678c521e3e3e24b1adb546d835a3774818359dd5025f7dbbe4fda874"} Jul 28 13:46:01.155923 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.155574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"3be3111e1d34d7fb7954777e9f22665d5c7aa9b3cbf8f6840d31add8094ac329"} Jul 28 13:46:01.155923 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.155600 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"f365f74f856f1e06f54b35001fc4ffc07dfef5100ff3567d3ea15cba9996376c"} Jul 28 13:46:01.155923 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.155628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"ba1610051fcc4b9e6b7b821f4ec818f5b1d92997ef695761a9da89215efe8f91"} Jul 28 13:46:01.155923 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.155652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d837adf5-f113-4c72-98c1-b7cf3eb0d67d","Type":"ContainerStarted","Data":"638371b234520c9dd1b1b679944ee602350a5bd1bef8566b2328e60ff1d5b46d"} Jul 28 13:46:01.189794 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.189736 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.179144881 podStartE2EDuration="2.189718311s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.57343ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:01.188338392 +0000 UTC m=+176.529634024" watchObservedRunningTime="2026-07-28 13:46:01.189718311 +0000 UTC m=+176.531013945" Jul 28 13:46:01.928304 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928260 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:46:01.928666 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928631 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="prometheus" containerID="cri-o://08bf5813d0593bb0034fa1786c7a929f59a5fbcc579678935a827062c7b7a664" gracePeriod=600 Jul 28 13:46:01.928666 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928652 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://df0edaafab38edaeb48f83ba906720e2eb93bff2166883cd40c1cff4a0ae9df9" gracePeriod=600 Jul 28 13:46:01.928860 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928670 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-web" containerID="cri-o://499009ed36f98402756f970239570292baff6e363b905f86ea6efd2a1415144d" gracePeriod=600 Jul 28 13:46:01.928860 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928697 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="config-reloader" containerID="cri-o://fa3f83521e85cff1c7c686d325e05808bf7f28f667dc428abffb3a33635f6589" gracePeriod=600 Jul 28 13:46:01.928860 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928670 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="thanos-sidecar" containerID="cri-o://7f5786ad9fbf241626625d0e818853259ebdf4b74a181636894be92766f4b034" gracePeriod=600 Jul 28 13:46:01.928860 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:01.928805 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy" containerID="cri-o://ed54ffe46eb7fce0b122417a516dcdbc637ce3d2b11a457dbc2b0367ff58757f" gracePeriod=600 Jul 28 13:46:02.170534 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170499 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="df0edaafab38edaeb48f83ba906720e2eb93bff2166883cd40c1cff4a0ae9df9" exitCode=0 Jul 28 13:46:02.170534 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170530 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="ed54ffe46eb7fce0b122417a516dcdbc637ce3d2b11a457dbc2b0367ff58757f" exitCode=0 Jul 28 13:46:02.170534 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170540 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="499009ed36f98402756f970239570292baff6e363b905f86ea6efd2a1415144d" exitCode=0 Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170550 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="7f5786ad9fbf241626625d0e818853259ebdf4b74a181636894be92766f4b034" exitCode=0 Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170559 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="fa3f83521e85cff1c7c686d325e05808bf7f28f667dc428abffb3a33635f6589" exitCode=0 Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170567 2566 generic.go:356] "Generic (PLEG): container finished" podID="31065774-1264-4ce9-ae5b-44cec497f37c" containerID="08bf5813d0593bb0034fa1786c7a929f59a5fbcc579678935a827062c7b7a664" exitCode=0 Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170568 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"df0edaafab38edaeb48f83ba906720e2eb93bff2166883cd40c1cff4a0ae9df9"} Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"ed54ffe46eb7fce0b122417a516dcdbc637ce3d2b11a457dbc2b0367ff58757f"} Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"499009ed36f98402756f970239570292baff6e363b905f86ea6efd2a1415144d"} Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170695 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"7f5786ad9fbf241626625d0e818853259ebdf4b74a181636894be92766f4b034"} Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"fa3f83521e85cff1c7c686d325e05808bf7f28f667dc428abffb3a33635f6589"} Jul 28 13:46:02.170949 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.170748 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"08bf5813d0593bb0034fa1786c7a929f59a5fbcc579678935a827062c7b7a664"} Jul 28 13:46:02.183472 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.183452 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:02.246698 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246662 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-thanos-prometheus-http-client-file\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246698 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246712 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-metrics-client-certs\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246746 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-metrics-client-ca\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246776 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-tls-assets\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246806 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-trusted-ca-bundle\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246869 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-kubelet-serving-ca-bundle\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246894 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-0\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.246928 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246925 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-config\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.246981 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-config-out\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247012 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4djv\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-kube-api-access-n4djv\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247045 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-2\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247070 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-web-config\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247099 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247142 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-1\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247168 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247253 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247209 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-db\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247265 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247286 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-tls\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247304 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247310 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247314 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-serving-certs-ca-bundle\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247385 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-grpc-tls\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.247647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247428 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-kube-rbac-proxy\") pod \"31065774-1264-4ce9-ae5b-44cec497f37c\" (UID: \"31065774-1264-4ce9-ae5b-44cec497f37c\") " Jul 28 13:46:02.248023 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.247646 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.248385 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.248305 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.248385 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.248332 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.248385 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.248349 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-configmap-metrics-client-ca\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.248385 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.248367 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.250095 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.250062 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.250345 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.250314 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.250730 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.250703 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.250815 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.250789 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:02.251619 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.251583 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.253581 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253535 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.253683 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253601 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-config-out" (OuterVolumeSpecName: "config-out") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:46:02.253763 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253741 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:46:02.253846 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253827 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.253902 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253881 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.253973 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253916 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.254023 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.253989 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.254303 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.254282 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-kube-api-access-n4djv" (OuterVolumeSpecName: "kube-api-access-n4djv") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "kube-api-access-n4djv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:46:02.254382 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.254351 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:46:02.255481 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.255458 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-config" (OuterVolumeSpecName: "config") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.267356 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.267329 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-web-config" (OuterVolumeSpecName: "web-config") pod "31065774-1264-4ce9-ae5b-44cec497f37c" (UID: "31065774-1264-4ce9-ae5b-44cec497f37c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:02.348757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348717 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348746 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348757 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348757 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-db\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348765 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348774 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-grpc-tls\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348782 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-kube-rbac-proxy\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348793 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348802 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-metrics-client-certs\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348810 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-tls-assets\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348818 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348826 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-config\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348833 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31065774-1264-4ce9-ae5b-44cec497f37c-config-out\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348842 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4djv\" (UniqueName: \"kubernetes.io/projected/31065774-1264-4ce9-ae5b-44cec497f37c-kube-api-access-n4djv\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348849 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31065774-1264-4ce9-ae5b-44cec497f37c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348857 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-web-config\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:02.348966 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:02.348865 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31065774-1264-4ce9-ae5b-44cec497f37c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-220.ec2.internal\" DevicePath \"\"" Jul 28 13:46:03.182567 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.182534 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31065774-1264-4ce9-ae5b-44cec497f37c","Type":"ContainerDied","Data":"841a5dd553467790b5f972d66c88f120aff7d9930296829d1486260023896062"} Jul 28 13:46:03.183063 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.182593 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.183063 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.182630 2566 scope.go:117] "RemoveContainer" containerID="df0edaafab38edaeb48f83ba906720e2eb93bff2166883cd40c1cff4a0ae9df9" Jul 28 13:46:03.190855 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.190838 2566 scope.go:117] "RemoveContainer" containerID="ed54ffe46eb7fce0b122417a516dcdbc637ce3d2b11a457dbc2b0367ff58757f" Jul 28 13:46:03.197938 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.197921 2566 scope.go:117] "RemoveContainer" containerID="499009ed36f98402756f970239570292baff6e363b905f86ea6efd2a1415144d" Jul 28 13:46:03.204517 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.204498 2566 scope.go:117] "RemoveContainer" containerID="7f5786ad9fbf241626625d0e818853259ebdf4b74a181636894be92766f4b034" Jul 28 13:46:03.211687 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.211599 2566 scope.go:117] "RemoveContainer" containerID="fa3f83521e85cff1c7c686d325e05808bf7f28f667dc428abffb3a33635f6589" Jul 28 13:46:03.211841 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.211820 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:46:03.216902 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.216881 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:46:03.219010 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.218991 2566 scope.go:117] "RemoveContainer" containerID="08bf5813d0593bb0034fa1786c7a929f59a5fbcc579678935a827062c7b7a664" Jul 28 13:46:03.226119 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.226105 2566 scope.go:117] "RemoveContainer" containerID="fe7834ed66b5e100026e2fcace55dad72d2a98b0fae0f883f4549e28fd8c3ead" Jul 28 13:46:03.267455 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267426 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:46:03.267767 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267752 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="init-config-reloader" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267770 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="init-config-reloader" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267783 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-web" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267791 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-web" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267803 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="prometheus" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267811 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="prometheus" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267824 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="thanos-sidecar" Jul 28 13:46:03.267844 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267833 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="thanos-sidecar" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267848 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-thanos" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267857 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-thanos" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267879 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="config-reloader" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267887 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="config-reloader" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267899 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267907 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267983 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="config-reloader" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.267994 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="thanos-sidecar" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.268003 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-thanos" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.268014 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy-web" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.268025 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="prometheus" Jul 28 13:46:03.268178 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.268035 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" containerName="kube-rbac-proxy" Jul 28 13:46:03.273404 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.273386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.285551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.285533 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 13:46:03.285635 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.285533 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 13:46:03.286416 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.286402 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 13:46:03.286649 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.286637 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 13:46:03.290647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.290632 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 13:46:03.295919 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.295903 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 13:46:03.296107 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296074 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 13:46:03.296299 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296078 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 13:46:03.296372 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296358 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 13:46:03.296433 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296381 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 13:46:03.296578 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296560 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nz744\"" Jul 28 13:46:03.296710 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296584 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-409eajdjadthe\"" Jul 28 13:46:03.296710 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296572 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 13:46:03.296710 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.296566 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 13:46:03.298252 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.298216 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 13:46:03.301169 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.301150 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 13:46:03.306821 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.306801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:46:03.357947 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.357911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.357947 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.357950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358157 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.357973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358157 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43c72617-9b25-4be0-9054-29b5a93c6bda-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358157 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358157 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9z6\" (UniqueName: \"kubernetes.io/projected/43c72617-9b25-4be0-9054-29b5a93c6bda-kube-api-access-8f9z6\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358213 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358256 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-config\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43c72617-9b25-4be0-9054-29b5a93c6bda-config-out\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358332 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-web-config\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.358617 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.358533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459261 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459261 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459261 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459244 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459325 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43c72617-9b25-4be0-9054-29b5a93c6bda-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459349 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9z6\" (UniqueName: \"kubernetes.io/projected/43c72617-9b25-4be0-9054-29b5a93c6bda-kube-api-access-8f9z6\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.459551 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-config\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43c72617-9b25-4be0-9054-29b5a93c6bda-config-out\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459611 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-web-config\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.459868 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460060 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.460009 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460734 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.460267 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.460734 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.460520 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.461288 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.461266 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.462538 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.462492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.463837 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.462994 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.463837 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.463728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.463837 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.463757 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.464036 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.463920 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43c72617-9b25-4be0-9054-29b5a93c6bda-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.464190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464119 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.464190 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464177 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.464571 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464547 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-web-config\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.464652 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464607 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.464707 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464677 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-config\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.465014 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464828 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43c72617-9b25-4be0-9054-29b5a93c6bda-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.465014 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464980 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43c72617-9b25-4be0-9054-29b5a93c6bda-config-out\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.465014 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.464993 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.466115 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.466098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43c72617-9b25-4be0-9054-29b5a93c6bda-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.473751 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.473728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9z6\" (UniqueName: \"kubernetes.io/projected/43c72617-9b25-4be0-9054-29b5a93c6bda-kube-api-access-8f9z6\") pod \"prometheus-k8s-0\" (UID: \"43c72617-9b25-4be0-9054-29b5a93c6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.582611 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.582574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:46:03.722322 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:03.722299 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:46:03.724487 ip-10-0-130-220 kubenswrapper[2566]: W0728 13:46:03.724463 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c72617_9b25_4be0_9054_29b5a93c6bda.slice/crio-d016d4708c3edf8a1680cd3ddc8d7bc947421d246d988543021ffb08d30bb10c WatchSource:0}: Error finding container d016d4708c3edf8a1680cd3ddc8d7bc947421d246d988543021ffb08d30bb10c: Status 404 returned error can't find the container with id d016d4708c3edf8a1680cd3ddc8d7bc947421d246d988543021ffb08d30bb10c Jul 28 13:46:04.188699 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:04.188669 2566 generic.go:356] "Generic (PLEG): container finished" podID="43c72617-9b25-4be0-9054-29b5a93c6bda" containerID="e7e2fab7bdaef20600472d7224be7ef64584ebcc4a4caf65aaf5894540c1f0d0" exitCode=0 Jul 28 13:46:04.189124 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:04.188750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerDied","Data":"e7e2fab7bdaef20600472d7224be7ef64584ebcc4a4caf65aaf5894540c1f0d0"} Jul 28 13:46:04.189124 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:04.188830 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"d016d4708c3edf8a1680cd3ddc8d7bc947421d246d988543021ffb08d30bb10c"} Jul 28 13:46:05.198208 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198176 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31065774-1264-4ce9-ae5b-44cec497f37c" path="/var/lib/kubelet/pods/31065774-1264-4ce9-ae5b-44cec497f37c/volumes" Jul 28 13:46:05.198690 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198671 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"a74534c34f2c7ccc52a7598f9c4a33666653fd5d621ae3cb02ffcfdbe5f473cc"} Jul 28 13:46:05.198735 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198728 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"571709da8190bbeb498990c259cf32abbe059a1069514d9c7649f31b0c300fd3"} Jul 28 13:46:05.198767 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198760 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"295180e18f9a4ece18f9d2db9be984b4d3d5a15c101dadb42843a1a66a9d398a"} Jul 28 13:46:05.198800 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"0772bc212ff72e0a16c2cda4ae078d6485476c79748ca1769897b2f044d9b3cf"} Jul 28 13:46:05.198914 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"bcc1d38e1eabbf1a094e7bc48c7b07e2cfa89271ddb9b756c0987b7eab1327c1"} Jul 28 13:46:05.198914 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.198829 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43c72617-9b25-4be0-9054-29b5a93c6bda","Type":"ContainerStarted","Data":"22cc5cc87e08d95cc30a891b3953147020f16f7b6f1298ffb145e0d74b9cc7fe"} Jul 28 13:46:05.231187 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:05.231133 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.212753095 podStartE2EDuration="2.231114838s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.361743ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:05.229576553 +0000 UTC m=+180.570872185" watchObservedRunningTime="2026-07-28 13:46:05.231114838 +0000 UTC m=+180.572410474" Jul 28 13:46:08.582982 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:46:08.582945 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:03.583650 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:47:03.583617 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:03.598777 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:47:03.598753 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:04.439406 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:47:04.439378 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:48:05.006999 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:48:05.006971 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:48:05.011742 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:48:05.011720 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:48:05.016647 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:48:05.016627 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 13:48:05.018236 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:48:05.018207 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:48:05.023801 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:48:05.023786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:53:05.034129 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:53:05.034104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:53:05.039151 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:53:05.039126 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:53:05.043485 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:53:05.043467 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:53:05.047765 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:53:05.047748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:58:05.063325 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:58:05.063190 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:58:05.069613 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:58:05.069590 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 13:58:05.070336 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:58:05.070308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 13:58:05.075623 ip-10-0-130-220 kubenswrapper[2566]: I0728 13:58:05.075582 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:03:05.092293 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:03:05.092258 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:03:05.096330 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:03:05.096306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:03:05.097423 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:03:05.097404 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:03:05.101087 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:03:05.101066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:08:05.119577 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:08:05.119546 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:08:05.120960 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:08:05.120942 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:08:05.124179 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:08:05.124163 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:08:05.125848 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:08:05.125830 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:13:05.146041 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:13:05.146008 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:13:05.148474 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:13:05.146154 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:13:05.150613 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:13:05.150595 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:13:05.150829 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:13:05.150763 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:16:26.506692 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:26.506662 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfp42_6b98d0d6-0c9a-4d2e-90fb-9b0957418e6b/global-pull-secret-syncer/0.log" Jul 28 14:16:26.718116 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:26.718086 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ht7bq_342902a2-1fcf-4b69-93d5-c3b95c60af33/konnectivity-agent/0.log" Jul 28 14:16:26.762192 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:26.762128 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-220.ec2.internal_e80f3fd793768cfa4cf0588123d22c76/haproxy/0.log" Jul 28 14:16:30.411371 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.411294 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/alertmanager/0.log" Jul 28 14:16:30.443152 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.443128 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/config-reloader/0.log" Jul 28 14:16:30.470202 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.470185 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/kube-rbac-proxy-web/0.log" Jul 28 14:16:30.499810 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.499789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/kube-rbac-proxy/0.log" Jul 28 14:16:30.527590 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.527571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/kube-rbac-proxy-metric/0.log" Jul 28 14:16:30.557220 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.557204 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/prom-label-proxy/0.log" Jul 28 14:16:30.581941 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.581921 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d837adf5-f113-4c72-98c1-b7cf3eb0d67d/init-config-reloader/0.log" Jul 28 14:16:30.778399 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.778376 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c8bf597bc-w8w97_bbc9e36f-7521-4567-8a16-20b41deaad42/metrics-server/0.log" Jul 28 14:16:30.883467 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.883443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvlgg_abdb99be-ba52-45b7-b670-3e498dcfeb1b/node-exporter/0.log" Jul 28 14:16:30.933644 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.933613 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvlgg_abdb99be-ba52-45b7-b670-3e498dcfeb1b/kube-rbac-proxy/0.log" Jul 28 14:16:30.982758 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:30.982740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvlgg_abdb99be-ba52-45b7-b670-3e498dcfeb1b/init-textfile/0.log" Jul 28 14:16:31.597336 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.597314 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/prometheus/0.log" Jul 28 14:16:31.665946 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.665927 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/config-reloader/0.log" Jul 28 14:16:31.734800 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.734741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/thanos-sidecar/0.log" Jul 28 14:16:31.800614 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.800589 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/kube-rbac-proxy-web/0.log" Jul 28 14:16:31.849763 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.849744 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/kube-rbac-proxy/0.log" Jul 28 14:16:31.899665 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.899647 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/kube-rbac-proxy-thanos/0.log" Jul 28 14:16:31.940147 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.940124 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43c72617-9b25-4be0-9054-29b5a93c6bda/init-config-reloader/0.log" Jul 28 14:16:31.992339 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:31.992281 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pp66z_f26baca8-6433-4bd9-90a2-eaaba3f05092/prometheus-operator/0.log" Jul 28 14:16:32.043691 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.043665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pp66z_f26baca8-6433-4bd9-90a2-eaaba3f05092/kube-rbac-proxy/0.log" Jul 28 14:16:32.104646 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.104621 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-sk24b_6739ec7f-9342-4bbd-a806-9a868f6f408f/prometheus-operator-admission-webhook/0.log" Jul 28 14:16:32.307608 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.307550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d4cf7465-fjf9v_4dcdc800-de69-45f9-b532-1d51f5fcc2ab/thanos-query/0.log" Jul 28 14:16:32.358653 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.358630 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d4cf7465-fjf9v_4dcdc800-de69-45f9-b532-1d51f5fcc2ab/kube-rbac-proxy-web/0.log" Jul 28 14:16:32.405576 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.405544 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d4cf7465-fjf9v_4dcdc800-de69-45f9-b532-1d51f5fcc2ab/kube-rbac-proxy/0.log" Jul 28 14:16:32.455394 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.455373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d4cf7465-fjf9v_4dcdc800-de69-45f9-b532-1d51f5fcc2ab/prom-label-proxy/0.log" Jul 28 14:16:32.504460 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.504443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d4cf7465-fjf9v_4dcdc800-de69-45f9-b532-1d51f5fcc2ab/kube-rbac-proxy-rules/0.log" Jul 28 14:16:32.542361 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:32.542344 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d4cf7465-fjf9v_4dcdc800-de69-45f9-b532-1d51f5fcc2ab/kube-rbac-proxy-metrics/0.log" Jul 28 14:16:33.425936 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.425894 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw"] Jul 28 14:16:33.429198 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.429178 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.431858 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.431837 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hn42g\"/\"default-dockercfg-dfdvd\"" Jul 28 14:16:33.431966 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.431842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hn42g\"/\"openshift-service-ca.crt\"" Jul 28 14:16:33.432572 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.432558 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hn42g\"/\"kube-root-ca.crt\"" Jul 28 14:16:33.440155 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.440134 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw"] Jul 28 14:16:33.547118 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.547086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-podres\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.547297 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.547126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljjq\" (UniqueName: \"kubernetes.io/projected/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-kube-api-access-fljjq\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.547297 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.547156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-proc\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.547297 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.547244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-lib-modules\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.547297 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.547284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-sys\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648246 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-lib-modules\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648390 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-sys\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648390 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-podres\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648495 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648381 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-lib-modules\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648495 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljjq\" (UniqueName: \"kubernetes.io/projected/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-kube-api-access-fljjq\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648495 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648385 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-sys\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648495 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648441 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-proc\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648495 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648461 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-podres\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.648732 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.648545 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-proc\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.657172 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.657148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljjq\" (UniqueName: \"kubernetes.io/projected/d3c724a0-a0d8-410c-835e-6d4f2aea3d3e-kube-api-access-fljjq\") pod \"perf-node-gather-daemonset-mdgfw\" (UID: \"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.739165 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.739139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:33.862378 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.862347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw"] Jul 28 14:16:33.865595 ip-10-0-130-220 kubenswrapper[2566]: W0728 14:16:33.865569 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd3c724a0_a0d8_410c_835e_6d4f2aea3d3e.slice/crio-ddc52875fd43ee980d45801ca03d67b15dc881359d66e51f6b3bfa4b25460f20 WatchSource:0}: Error finding container ddc52875fd43ee980d45801ca03d67b15dc881359d66e51f6b3bfa4b25460f20: Status 404 returned error can't find the container with id ddc52875fd43ee980d45801ca03d67b15dc881359d66e51f6b3bfa4b25460f20 Jul 28 14:16:33.961755 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.961735 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/2.log" Jul 28 14:16:33.965536 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:33.965507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8h7js_95e3939b-e7c0-4324-ba77-fe66ef6b1a0c/console-operator/3.log" Jul 28 14:16:34.264051 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:34.263963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" event={"ID":"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e","Type":"ContainerStarted","Data":"54ce6eb6a4d550bd5108d3a65bfc3dfd00154342900dfab976f027842c0b4de8"} Jul 28 14:16:34.264051 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:34.264021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" event={"ID":"d3c724a0-a0d8-410c-835e-6d4f2aea3d3e","Type":"ContainerStarted","Data":"ddc52875fd43ee980d45801ca03d67b15dc881359d66e51f6b3bfa4b25460f20"} Jul 28 14:16:34.264318 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:34.264064 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:34.283464 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:34.283407 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" podStartSLOduration=1.283389508 podStartE2EDuration="1.283389508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:16:34.281211596 +0000 UTC m=+2009.622507228" watchObservedRunningTime="2026-07-28 14:16:34.283389508 +0000 UTC m=+2009.624685141" Jul 28 14:16:34.853875 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:34.853849 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-fbtp2_b94ec497-3bd3-4b87-915a-c3bd2955246a/volume-data-source-validator/0.log" Jul 28 14:16:35.721387 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:35.721362 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qns6w_f03648b4-6f6a-4973-b0b6-9eafd512d3f0/dns/0.log" Jul 28 14:16:35.744269 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:35.744243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qns6w_f03648b4-6f6a-4973-b0b6-9eafd512d3f0/kube-rbac-proxy/0.log" Jul 28 14:16:35.885693 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:35.885671 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z6qmq_29b4e541-65ae-4874-9d60-76bec859fbe0/dns-node-resolver/0.log" Jul 28 14:16:36.344194 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:36.344167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b4rfl_cac480a5-23cc-4692-9ed9-835ce99fd71b/node-ca/0.log" Jul 28 14:16:37.203117 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:37.203086 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-864dc66f5f-52wc4_d43f7756-30db-49ae-9aed-6f20c415bf75/router/0.log" Jul 28 14:16:37.545839 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:37.545770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7r4zt_e5f8a677-83cc-4afa-a08c-6036a27c657a/serve-healthcheck-canary/0.log" Jul 28 14:16:38.128740 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:38.128711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4qn7_bf75689e-2bb4-456c-bd7b-9a7f4006e4df/kube-rbac-proxy/0.log" Jul 28 14:16:38.149929 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:38.149905 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4qn7_bf75689e-2bb4-456c-bd7b-9a7f4006e4df/exporter/0.log" Jul 28 14:16:38.171968 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:38.171951 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4qn7_bf75689e-2bb4-456c-bd7b-9a7f4006e4df/extractor/0.log" Jul 28 14:16:40.277618 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:40.277595 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-mdgfw" Jul 28 14:16:43.198624 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:43.198594 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x_3e7cb077-c80f-43b8-a75e-951f88654519/kube-storage-version-migrator-operator/1.log" Jul 28 14:16:43.199351 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:43.199331 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-zmc5x_3e7cb077-c80f-43b8-a75e-951f88654519/kube-storage-version-migrator-operator/0.log" Jul 28 14:16:44.036732 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.036707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/kube-multus-additional-cni-plugins/0.log" Jul 28 14:16:44.067462 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.067439 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/egress-router-binary-copy/0.log" Jul 28 14:16:44.093320 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.093270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/cni-plugins/0.log" Jul 28 14:16:44.118575 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.118553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/bond-cni-plugin/0.log" Jul 28 14:16:44.143389 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.143371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/routeoverride-cni/0.log" Jul 28 14:16:44.166817 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.166802 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/whereabouts-cni-bincopy/0.log" Jul 28 14:16:44.192067 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.192044 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j48v7_3769c3b5-31ef-45e8-bebf-0bde9679ebd3/whereabouts-cni/0.log" Jul 28 14:16:44.607720 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.607693 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gwdhd_909de677-86e1-4962-90b8-ae7a5a4e875f/kube-multus/0.log" Jul 28 14:16:44.806769 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.806743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sp6g4_dfcc0950-639c-40b6-8fdd-dfd780e0b6c9/network-metrics-daemon/0.log" Jul 28 14:16:44.829373 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:44.829349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sp6g4_dfcc0950-639c-40b6-8fdd-dfd780e0b6c9/kube-rbac-proxy/0.log" Jul 28 14:16:46.048156 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.048127 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-controller/0.log" Jul 28 14:16:46.070205 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.070179 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/0.log" Jul 28 14:16:46.070356 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.070211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovn-acl-logging/1.log" Jul 28 14:16:46.091996 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.091966 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/kube-rbac-proxy-node/0.log" Jul 28 14:16:46.122196 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.122175 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 14:16:46.148519 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.148498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/northd/0.log" Jul 28 14:16:46.185348 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.185326 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/nbdb/0.log" Jul 28 14:16:46.256152 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.256129 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/sbdb/0.log" Jul 28 14:16:46.311599 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:46.311532 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nx7bb_03a622cd-d09c-46df-944d-f746438788d5/ovnkube-controller/0.log" Jul 28 14:16:47.411619 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:47.411585 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-df58h_8fc47e2e-7fdc-441c-a1ac-623d8e5ceb5b/network-check-target-container/0.log" Jul 28 14:16:48.399202 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:48.399178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-pnh9c_f41c1866-949d-4ad4-928d-4a553af076ec/iptables-alerter/0.log" Jul 28 14:16:49.188925 ip-10-0-130-220 kubenswrapper[2566]: I0728 14:16:49.188896 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zpwhh_3f3f6359-b763-44bb-b068-403ce35f8083/tuned/0.log"