Jul 01 16:58:12.804803 ip-10-0-140-96 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:58:13.199189 ip-10-0-140-96 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:58:13.199189 ip-10-0-140-96 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:58:13.199189 ip-10-0-140-96 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:58:13.199189 ip-10-0-140-96 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:58:13.199189 ip-10-0-140-96 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:58:13.201592 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.201486 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:58:13.206586 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206570 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206587 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206591 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206594 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206599 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206604 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206607 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206610 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206614 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206617 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206620 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206622 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206625 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206628 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206631 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:13.206626 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206634 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206638 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206642 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206646 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206650 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206675 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206695 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206699 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206702 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206706 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206709 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206712 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206717 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206722 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206726 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206729 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206732 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206735 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206737 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:13.206979 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206740 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206743 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206745 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206748 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206751 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206753 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206757 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206759 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206762 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206765 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206767 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206773 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206775 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206778 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206781 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206783 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206786 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206789 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206791 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206795 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:13.207422 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206797 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206800 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206803 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206805 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206808 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206811 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206814 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206816 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206819 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206821 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206823 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206826 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206829 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206832 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206834 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206837 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206840 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206843 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206845 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206848 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:13.207920 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206850 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206853 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206856 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206858 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206863 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206866 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206868 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206871 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206874 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206878 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206882 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206886 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206889 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206892 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206894 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206897 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206900 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206902 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206905 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:13.208394 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206907 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206910 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206912 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206915 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206917 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.206920 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207699 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207706 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207709 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207711 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207715 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207718 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207720 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207723 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207725 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207728 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207731 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207734 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207737 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207741 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:13.208862 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207744 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207747 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207750 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207753 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207755 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207758 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207761 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207763 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207766 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207768 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207771 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207773 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207776 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207778 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207781 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207783 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207786 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207788 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207790 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207793 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:13.209340 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207795 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207798 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207800 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207803 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207805 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207808 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207811 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207813 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207815 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207818 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207821 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207824 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207827 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207829 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207832 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207835 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207838 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207840 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207843 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207845 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:13.209844 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207848 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207850 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207853 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207855 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207857 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207860 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207862 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207865 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207867 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207870 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207872 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207874 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207877 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207879 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207882 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207886 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207890 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207894 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207897 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:13.210324 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207900 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207903 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207906 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207909 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207912 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207915 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207918 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207921 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207924 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207928 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207931 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207934 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207938 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207942 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207945 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207948 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207950 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207953 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207956 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207958 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:13.210804 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207961 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207963 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207966 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207968 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207971 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.207974 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208373 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208378 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208381 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208384 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208387 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208390 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208392 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208394 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208398 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208401 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208404 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208407 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208409 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208412 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:13.211277 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208415 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208417 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208420 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208423 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208425 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208428 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208430 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208433 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208436 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208438 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208440 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208443 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208445 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208448 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208451 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208453 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208456 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208459 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208461 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208464 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:13.211802 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208466 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208468 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208471 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208474 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208476 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208478 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208481 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208484 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208486 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208489 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208508 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208511 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208513 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208516 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208519 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208521 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208524 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208526 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208530 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:13.212273 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208533 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208537 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208539 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208542 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208544 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208547 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208550 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208552 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208555 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208557 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208560 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208562 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208565 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208567 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208571 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208575 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208578 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208581 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208584 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:13.212739 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208587 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208589 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208592 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208594 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208597 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208600 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208602 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208605 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208608 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208610 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208613 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208616 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208618 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208621 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208623 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208627 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208630 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208633 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208637 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:13.213223 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208640 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208643 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208646 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208648 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208651 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208654 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208656 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.208659 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208729 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208736 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208742 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208747 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208752 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208755 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208760 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208764 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208767 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208770 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208774 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208777 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208780 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208783 2577 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208786 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:58:13.213694 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208789 2577 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208792 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208795 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208800 2577 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208803 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208806 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208809 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208812 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208816 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208819 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208822 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208826 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208829 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208832 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208834 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208838 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208840 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208844 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208847 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208850 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208853 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208857 2577 flags.go:64] FLAG: --enable-server="true" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208860 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208864 2577 flags.go:64] FLAG: --event-burst="100" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208867 2577 flags.go:64] FLAG: --event-qps="50" Jul 01 16:58:13.214234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208870 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208874 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208877 2577 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208881 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208884 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208887 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208890 2577 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208893 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208895 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208898 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208901 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208904 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208906 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208909 2577 flags.go:64] FLAG: --feature-gates="" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208917 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208920 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208923 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208926 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208929 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208932 2577 flags.go:64] FLAG: --help="false" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208935 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208938 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208941 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:58:13.214832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208944 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208947 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208951 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208953 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208956 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208959 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208962 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208965 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208968 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208971 2577 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208974 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208977 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208980 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208982 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208985 2577 flags.go:64] FLAG: --lock-file="" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208988 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208991 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208994 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.208999 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209002 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209004 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209007 2577 flags.go:64] FLAG: --logging-format="text" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209010 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209015 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:58:13.215395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209018 2577 flags.go:64] FLAG: --manifest-url="" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209021 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209025 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209028 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209032 2577 flags.go:64] FLAG: --max-pods="110" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209035 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209038 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209041 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209044 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209047 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209049 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209053 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209060 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209062 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209065 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209072 2577 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209075 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209080 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209083 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209086 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209089 2577 flags.go:64] FLAG: --port="10250" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209092 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209095 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02789fc87ed9b6d31" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209098 2577 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:58:13.216012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209101 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209104 2577 flags.go:64] FLAG: --register-node="true" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209107 2577 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209111 2577 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209114 2577 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209116 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209119 2577 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209123 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209127 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209130 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209133 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209135 2577 flags.go:64] FLAG: --runonce="false" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209138 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209141 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209144 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209147 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209150 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209152 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209156 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209159 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209162 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209165 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209167 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209170 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209174 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:58:13.216621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209177 2577 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209180 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209186 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209188 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209191 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209196 2577 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209199 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209201 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209204 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209207 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209210 2577 flags.go:64] FLAG: --v="2" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209214 2577 flags.go:64] FLAG: --version="false" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209218 2577 flags.go:64] FLAG: --vmodule="" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209221 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.209225 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209341 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209345 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209349 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209352 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209354 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209357 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209360 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209362 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:13.217207 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209365 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209369 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209372 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209376 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209380 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209384 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209387 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209390 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209393 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209397 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209399 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209402 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209405 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209407 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209410 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209412 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209416 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209418 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209421 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:13.217780 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209424 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209426 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209429 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209448 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209451 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209457 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209459 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209462 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209465 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209467 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209470 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209472 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209475 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209477 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209479 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209482 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209487 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209504 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209508 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209511 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:13.218239 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209513 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209516 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209518 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209521 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209524 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209527 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209530 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209532 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209535 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209538 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209540 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209543 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209545 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209548 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209550 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209553 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209556 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209559 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209562 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209564 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:13.218753 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209567 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209570 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209572 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209575 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209577 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209580 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209582 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209585 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209589 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209591 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209594 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209596 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209599 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209601 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209604 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209606 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209609 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209612 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209614 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:13.219219 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209617 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209619 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209622 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209624 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209627 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209629 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209631 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209634 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209636 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209639 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209643 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209647 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.209650 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.210243 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:58:13.219940 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.217454 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.217475 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.217512 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.217519 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217600 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217605 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217609 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217612 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217616 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217619 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217622 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217625 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217628 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217631 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217633 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217636 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217638 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217641 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217644 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217647 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:13.220572 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217649 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217652 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217654 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217657 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217659 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217662 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217665 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217668 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217670 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217673 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217675 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217678 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217681 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217690 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217693 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217696 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217698 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217701 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217704 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217707 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:13.221093 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217709 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217712 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217714 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217716 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217719 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217722 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217725 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217727 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217730 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217733 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217735 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217738 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217740 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217743 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217745 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217748 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217750 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217755 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217758 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217761 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:13.221583 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217764 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217767 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217770 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217772 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217775 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217779 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217787 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217791 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217795 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217798 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217801 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217804 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217806 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217809 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217811 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217814 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217816 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217819 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217821 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217824 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:13.222066 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217826 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217829 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217832 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217834 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217837 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217839 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217842 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217844 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217847 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217850 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217853 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217855 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217858 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217860 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217863 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217865 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217870 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217874 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217877 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:13.222584 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217889 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217892 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217895 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.217898 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.217903 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218055 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218059 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218062 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218066 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218070 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218073 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218076 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218079 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218081 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218084 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:13.223027 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218087 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218089 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218092 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218094 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218097 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218099 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218102 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218104 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218107 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218109 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218112 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218114 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218117 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218119 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218122 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218124 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218127 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218129 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218138 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:13.223387 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218141 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218143 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218146 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218148 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218151 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218154 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218156 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218159 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218161 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218163 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218172 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218174 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218177 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218179 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218182 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218184 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218187 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218189 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218192 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:13.223888 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218194 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218197 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218199 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218202 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218204 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218206 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218209 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218212 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218214 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218217 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218219 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218222 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218224 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218233 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218235 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218238 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218242 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218246 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218250 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218253 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:13.224346 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218256 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218259 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218261 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218264 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218267 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218269 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218272 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218275 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218277 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218279 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218282 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218284 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218287 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218289 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218292 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218295 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218297 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218300 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218302 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218305 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:13.224846 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218307 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218310 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218313 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218315 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218318 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218320 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218328 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218331 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218333 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218336 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:13.218338 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.218344 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.218481 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.223120 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:58:13.225318 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.224854 2577 server.go:1019] "Starting client certificate rotation" Jul 01 16:58:13.225683 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.224958 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:58:13.225683 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.225000 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:58:13.227336 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.227321 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:58:13.228534 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.228514 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:58:13.241611 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.241592 2577 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:58:13.245866 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.245845 2577 log.go:25] "Validated CRI v1 image API" Jul 01 16:58:13.249924 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.249906 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:58:13.254858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.254832 2577 fs.go:135] Filesystem UUIDs: map[765bc14b-eca9-41c2-9ed5-484ca50ef33b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c1efa6f6-7520-4352-a7e0-775f7e15b1ff:/dev/nvme0n1p4] Jul 01 16:58:13.254964 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.254854 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:58:13.255968 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.255945 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:58:13.261341 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.261222 2577 manager.go:216] Machine: {Timestamp:2026-07-01 16:58:13.259972208 +0000 UTC m=+0.337724690 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099813 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23e0a2c6c2290c6450b48f3535c46c SystemUUID:ec23e0a2-c6c2-290c-6450-b48f3535c46c BootID:5258122b-f878-474d-83da-78c2fbe1dedf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:1d:26:e0:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:1d:26:e0:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:b6:3b:27:64:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:58:13.261341 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.261328 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:58:13.261509 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.261443 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:58:13.264412 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.264381 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:58:13.264573 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.264416 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:58:13.265207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.265197 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:58:13.265242 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.265210 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:58:13.265242 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.265218 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:58:13.265720 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.265709 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:58:13.266558 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.266548 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:58:13.271247 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271234 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:58:13.271377 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271367 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:58:13.271415 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271398 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:58:13.271415 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271407 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:58:13.271476 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271421 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:58:13.271476 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271430 2577 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:58:13.271476 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271440 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:58:13.271914 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271883 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:58:13.271914 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.271909 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:58:13.275159 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.275134 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:58:13.276844 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.276824 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:58:13.276929 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.276864 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:58:13.277536 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277516 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:58:13.277536 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277535 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277545 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277553 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277569 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277577 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277589 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277597 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277607 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277616 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277630 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:58:13.277696 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.277638 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:58:13.279362 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.279350 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:58:13.279427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.279365 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:58:13.282749 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.282733 2577 server.go:1268] "Started kubelet" Jul 01 16:58:13.282900 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.282824 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:58:13.282965 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.282920 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:58:13.282965 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.282922 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:58:13.283087 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.283065 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:58:13.283202 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.283114 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:58:13.283202 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.283159 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:58:13.283569 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.283554 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rlwz" Jul 01 16:58:13.283700 ip-10-0-140-96 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:58:13.284046 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.284024 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:58:13.285567 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.285553 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:58:13.289576 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.289548 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:58:13.291649 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.291628 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:58:13.291749 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.291728 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.291816 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.291632 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:58:13.292184 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292164 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:58:13.292184 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.291136 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-96.ec2.internal.18be38ed0e3eef9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-96.ec2.internal,UID:ip-10-0-140-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-96.ec2.internal,},FirstTimestamp:2026-07-01 16:58:13.282705308 +0000 UTC m=+0.360457790,LastTimestamp:2026-07-01 16:58:13.282705308 +0000 UTC m=+0.360457790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-96.ec2.internal,}" Jul 01 16:58:13.292184 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292181 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:58:13.292397 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292306 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rlwz" Jul 01 16:58:13.292397 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292330 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:58:13.292397 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292339 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:58:13.292397 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292395 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:58:13.292599 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292581 2577 factory.go:55] Registering systemd factory Jul 01 16:58:13.292599 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292595 2577 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:58:13.293055 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292918 2577 factory.go:153] Registering CRI-O factory Jul 01 16:58:13.293055 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292934 2577 factory.go:223] Registration of the crio container factory successfully Jul 01 16:58:13.293055 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.292989 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:58:13.293055 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.293018 2577 factory.go:103] Registering Raw factory Jul 01 16:58:13.293055 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.293033 2577 manager.go:1196] Started watching for new ooms in manager Jul 01 16:58:13.293454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.293436 2577 manager.go:349] Starting recovery of all containers Jul 01 16:58:13.297372 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.297341 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:58:13.297536 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.297510 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:58:13.306071 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.306055 2577 manager.go:354] Recovery completed Jul 01 16:58:13.310217 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.310198 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.312083 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312066 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.312151 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312098 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.312151 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312111 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.312679 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312665 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:58:13.312679 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312677 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:58:13.312679 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312680 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.312849 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.312696 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:58:13.313285 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.313271 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.313350 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.313293 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.313350 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.313302 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.313823 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.313811 2577 policy_none.go:49] "None policy: Start" Jul 01 16:58:13.313860 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.313827 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:58:13.313860 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.313837 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:58:13.314958 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.314940 2577 policy_none.go:47] "Start" Jul 01 16:58:13.352178 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352162 2577 manager.go:337] "Starting Device Plugin manager" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.352195 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352207 2577 server.go:87] "Starting device plugin registration server" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352541 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352555 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352660 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352742 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.352752 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.353367 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.353431 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.358697 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.360027 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.360078 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.360111 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.360143 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:58:13.363655 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.362485 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:13.452727 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.452648 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.453683 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.453665 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.453782 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.453695 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.453782 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.453704 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.453782 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.453729 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.460559 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.460528 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"] Jul 01 16:58:13.460689 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.460593 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.460689 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.460600 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.460689 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.460625 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-96.ec2.internal\": node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.461352 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.461334 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.461422 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.461367 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.461422 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.461381 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.462767 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.462755 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.462942 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.462929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.462993 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.462958 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.463552 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.463536 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.463648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.463557 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.463648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.463564 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.463648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.463586 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.463648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.463570 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.463648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.463599 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.464725 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.464709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.464821 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.464735 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:13.465296 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.465276 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:13.465378 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.465304 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:13.465378 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.465317 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:13.480704 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.480686 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.494344 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.494316 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-96.ec2.internal\" not found" node="ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.498852 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.498835 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-96.ec2.internal\" not found" node="ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.580781 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.580748 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.592844 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.592819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f36dc18b292c3718a761252503d2644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"4f36dc18b292c3718a761252503d2644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.592912 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.592849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46679bc7f7ce1d9afc659dfd5f23d201-config\") pod \"kube-apiserver-proxy-ip-10-0-140-96.ec2.internal\" (UID: \"46679bc7f7ce1d9afc659dfd5f23d201\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.592912 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.592871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f36dc18b292c3718a761252503d2644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"4f36dc18b292c3718a761252503d2644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.680943 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.680911 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.693076 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.693048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f36dc18b292c3718a761252503d2644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"4f36dc18b292c3718a761252503d2644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.693180 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.693078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f36dc18b292c3718a761252503d2644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"4f36dc18b292c3718a761252503d2644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.693180 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.693096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46679bc7f7ce1d9afc659dfd5f23d201-config\") pod \"kube-apiserver-proxy-ip-10-0-140-96.ec2.internal\" (UID: \"46679bc7f7ce1d9afc659dfd5f23d201\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.693180 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.693124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46679bc7f7ce1d9afc659dfd5f23d201-config\") pod \"kube-apiserver-proxy-ip-10-0-140-96.ec2.internal\" (UID: \"46679bc7f7ce1d9afc659dfd5f23d201\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.693180 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.693141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f36dc18b292c3718a761252503d2644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"4f36dc18b292c3718a761252503d2644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.693180 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.693152 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f36dc18b292c3718a761252503d2644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"4f36dc18b292c3718a761252503d2644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.782018 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.781929 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.797302 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.797282 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.802482 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:13.802462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" Jul 01 16:58:13.882687 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.882646 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:13.983106 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:13.983076 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.083636 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.083568 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.184226 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.184197 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.224734 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:14.224686 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:58:14.225173 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:14.224845 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:58:14.261119 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:14.261086 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:14.284266 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.284243 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.296387 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:14.296352 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:53:14 +0000 UTC" deadline="2028-01-25 19:08:33.464541718 +0000 UTC" Jul 01 16:58:14.296387 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:14.296379 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13754h10m19.168165672s" Jul 01 16:58:14.385427 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.385351 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.485871 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.485833 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.561073 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:14.561041 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46679bc7f7ce1d9afc659dfd5f23d201.slice/crio-bfaf659aac34f3a1894acb08e5e42f7fb135da4f4015da934a2dc19959a78883 WatchSource:0}: Error finding container bfaf659aac34f3a1894acb08e5e42f7fb135da4f4015da934a2dc19959a78883: Status 404 returned error can't find the container with id bfaf659aac34f3a1894acb08e5e42f7fb135da4f4015da934a2dc19959a78883 Jul 01 16:58:14.561283 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:14.561264 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f36dc18b292c3718a761252503d2644.slice/crio-92c162ac1a1ff8f8b9a5bc3c403541a2a346637ab986d40f0437198ac877a87c WatchSource:0}: Error finding container 92c162ac1a1ff8f8b9a5bc3c403541a2a346637ab986d40f0437198ac877a87c: Status 404 returned error can't find the container with id 92c162ac1a1ff8f8b9a5bc3c403541a2a346637ab986d40f0437198ac877a87c Jul 01 16:58:14.566910 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:14.566895 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:58:14.586946 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.586918 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:14.687546 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:14.687469 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:16.242829 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.242808 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:16.330450 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.330413 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found" Jul 01 16:58:16.408150 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.408128 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:16.435236 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.435218 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" Jul 01 16:58:16.445989 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.445970 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:58:16.447028 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.447016 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" Jul 01 16:58:16.463272 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.463253 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:58:16.814357 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.814325 2577 apiserver.go:52] "Watching apiserver" Jul 01 16:58:16.822208 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.822177 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:58:16.822518 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.822494 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-nmzfr","kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf","openshift-image-registry/node-ca-wsnqw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal","openshift-multus/multus-additional-cni-plugins-wpf8t","openshift-network-diagnostics/network-check-target-wxxg6","openshift-network-operator/iptables-alerter-9bxrr","kube-system/global-pull-secret-syncer-26c5b","openshift-cluster-node-tuning-operator/tuned-pd2wh","openshift-dns/node-resolver-jtdkf","openshift-multus/multus-9k7tj","openshift-multus/network-metrics-daemon-mcrjd","openshift-ovn-kubernetes/ovnkube-node-z9pvd"] Jul 01 16:58:16.824734 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.824716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:16.824812 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.824793 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:16.826143 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.826124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.827518 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.827496 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.828647 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.828621 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.828647 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.828634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vpd46\"" Jul 01 16:58:16.828805 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.828628 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.829133 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.829113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.829972 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.829940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:58:16.830094 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.830068 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.830293 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.830278 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x6s5b\"" Jul 01 16:58:16.830359 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.830282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.831093 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.831067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.832615 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.832597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.832849 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.832733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.833162 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.833107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:58:16.833260 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.833221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p8twl\"" Jul 01 16:58:16.833447 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.833429 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.834259 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.834357 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.834305 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:16.834560 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834372 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.834623 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834612 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:58:16.834674 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:58:16.834982 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x2l9q\"" Jul 01 16:58:16.834982 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834805 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.834982 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.834951 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:58:16.835157 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.835122 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:58:16.835738 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.835715 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:58:16.835831 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.835772 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:58:16.836212 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.835970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:16.836212 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.835990 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.836212 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.836029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:58:16.836212 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.836029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:16.836212 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.836083 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:58:16.836212 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.836126 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.836559 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.836411 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ttdvv\"" Jul 01 16:58:16.837775 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.837754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:16.840001 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.839984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.840795 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.840778 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.841836 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.841815 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.841836 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.841830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:16.841990 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.841940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:58:16.842205 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wz8r8\"" Jul 01 16:58:16.842205 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-68dxp\"" Jul 01 16:58:16.842339 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-node-log\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.842339 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-kubelet-config\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.842339 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn26x\" (UniqueName: \"kubernetes.io/projected/ae6e244c-2600-44bd-ba30-7550176e8a53-kube-api-access-fn26x\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.842488 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-registration-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.842488 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-device-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.842488 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-kubelet\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.842488 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-etc-selinux\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-systemd\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-cni-netd\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovnkube-script-lib\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2d1da7a-f169-4354-906a-a3d825d1c2f5-serviceca\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-cnibin\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5njqd\" (UniqueName: \"kubernetes.io/projected/12b2765d-53b9-4f4a-b4e6-88bd94cde305-kube-api-access-5njqd\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:16.842681 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae6e244c-2600-44bd-ba30-7550176e8a53-hosts-file\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-ovn\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-run-ovn-kubernetes\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovn-node-metrics-cert\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-dbus\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-slash\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-log-socket\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.842988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-env-overrides\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-systemd-units\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-var-lib-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-etc-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6e244c-2600-44bd-ba30-7550176e8a53-tmp-dir\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kwq5\" (UniqueName: \"kubernetes.io/projected/ea40ee70-811f-4e27-9e83-fb970c84312b-kube-api-access-2kwq5\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-run-netns\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovnkube-config\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.843427 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvgzx\" (UniqueName: \"kubernetes.io/projected/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-kube-api-access-nvgzx\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.844097 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:16.844097 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:16.844097 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.844256 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.843516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-sys-fs\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.844374 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-cni-bin\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.844487 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zsjs\" (UniqueName: \"kubernetes.io/projected/e2d1da7a-f169-4354-906a-a3d825d1c2f5-kube-api-access-6zsjs\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.844590 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-system-cni-dir\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.844590 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-os-release\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.844590 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mkk4\" (UniqueName: \"kubernetes.io/projected/ba50a4c5-bdd8-4295-8285-999519a9e53e-kube-api-access-9mkk4\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.844734 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-socket-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.844734 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2d1da7a-f169-4354-906a-a3d825d1c2f5-host\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.844734 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.844878 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.844796 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:58:16.845052 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.845007 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:58:16.845476 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.845453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.846242 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.846026 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:58:16.846242 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.846128 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:58:16.846385 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.846291 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xssw6\"" Jul 01 16:58:16.847905 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.847889 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:58:16.848286 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.848268 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rqcbm\"" Jul 01 16:58:16.852433 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.852410 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:58:16.893678 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.893646 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj8jj" Jul 01 16:58:16.904969 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.904928 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj8jj" Jul 01 16:58:16.909723 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.909641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"4f36dc18b292c3718a761252503d2644","Type":"ContainerStarted","Data":"92c162ac1a1ff8f8b9a5bc3c403541a2a346637ab986d40f0437198ac877a87c"} Jul 01 16:58:16.911084 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.911060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" event={"ID":"46679bc7f7ce1d9afc659dfd5f23d201","Type":"ContainerStarted","Data":"bfaf659aac34f3a1894acb08e5e42f7fb135da4f4015da934a2dc19959a78883"} Jul 01 16:58:16.931570 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.931537 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:16.936410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.936381 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:58:16.945191 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5njqd\" (UniqueName: \"kubernetes.io/projected/12b2765d-53b9-4f4a-b4e6-88bd94cde305-kube-api-access-5njqd\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae6e244c-2600-44bd-ba30-7550176e8a53-hosts-file\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-ovn\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovn-node-metrics-cert\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-os-release\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae959d92-64f2-40bd-92b1-55365ec3e889-tmp\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-dbus\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.945391 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945375 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-log-socket\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-env-overrides\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysctl-conf\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-host\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-dbus\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.945732 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:16.945812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-log-socket\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946162 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.945829 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:17.445787245 +0000 UTC m=+2.981077669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:16.946162 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-ovn\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946162 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.945730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae6e244c-2600-44bd-ba30-7550176e8a53-hosts-file\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.946162 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-systemd-units\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946162 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-var-lib-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946162 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-system-cni-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-cnibin\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-k8s-cni-cncf-io\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-kubelet\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-env-overrides\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-run-netns\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946344 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvgzx\" (UniqueName: \"kubernetes.io/projected/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-kube-api-access-nvgzx\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-os-release\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mkk4\" (UniqueName: \"kubernetes.io/projected/ba50a4c5-bdd8-4295-8285-999519a9e53e-kube-api-access-9mkk4\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.946454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-sys-fs\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-cni-bin\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zsjs\" (UniqueName: \"kubernetes.io/projected/e2d1da7a-f169-4354-906a-a3d825d1c2f5-kube-api-access-6zsjs\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98bebf84-ada9-4d90-b385-f95c02c8a683-konnectivity-ca\") pod \"konnectivity-agent-nmzfr\" (UID: \"98bebf84-ada9-4d90-b385-f95c02c8a683\") " pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysconfig\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-var-lib-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c882f671-340a-49e9-86d2-9bb0d8c75658-cni-binary-copy\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-run-netns\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-multus-certs\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-sys-fs\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-os-release\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-systemd-units\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.946902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-cni-bin\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-etc-kubernetes\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.946975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-run\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-tuned\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-node-log\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-node-log\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-registration-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-device-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-registration-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-kubelet\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-device-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-systemd\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-systemd\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-modprobe-d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-kubelet\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-etc-selinux\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.947411 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-cnibin\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-socket-dir-parent\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-netns\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-cnibin\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-daemon-config\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-etc-selinux\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-sys\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-run-ovn-kubernetes\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-cni-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-run-ovn-kubernetes\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-cni-multus\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-conf-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-var-lib-kubelet\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-slash\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98bebf84-ada9-4d90-b385-f95c02c8a683-agent-certs\") pod \"konnectivity-agent-nmzfr\" (UID: \"98bebf84-ada9-4d90-b385-f95c02c8a683\") " pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-hostroot\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.948144 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-slash\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjwbj\" (UniqueName: \"kubernetes.io/projected/c882f671-340a-49e9-86d2-9bb0d8c75658-kube-api-access-kjwbj\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-etc-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-iptables-alerter-script\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysctl-d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6e244c-2600-44bd-ba30-7550176e8a53-tmp-dir\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-etc-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kwq5\" (UniqueName: \"kubernetes.io/projected/ea40ee70-811f-4e27-9e83-fb970c84312b-kube-api-access-2kwq5\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.947975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovnkube-config\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-system-cni-dir\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba50a4c5-bdd8-4295-8285-999519a9e53e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-cni-bin\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:16.949009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-host-slash\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-kubernetes\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-systemd\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6e244c-2600-44bd-ba30-7550176e8a53-tmp-dir\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-lib-modules\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-socket-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2d1da7a-f169-4354-906a-a3d825d1c2f5-host\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-kubelet-config\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn26x\" (UniqueName: \"kubernetes.io/projected/ae6e244c-2600-44bd-ba30-7550176e8a53-kube-api-access-fn26x\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-cni-netd\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2d1da7a-f169-4354-906a-a3d825d1c2f5-serviceca\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-system-cni-dir\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovnkube-script-lib\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkk9h\" (UniqueName: \"kubernetes.io/projected/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-kube-api-access-fkk9h\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovnkube-config\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.949731 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l558d\" (UniqueName: \"kubernetes.io/projected/ae959d92-64f2-40bd-92b1-55365ec3e889-kube-api-access-l558d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.948659 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.948705 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:17.448689712 +0000 UTC m=+2.983980113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-kubelet-config\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-run-openvswitch\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovnkube-script-lib\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.948992 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2d1da7a-f169-4354-906a-a3d825d1c2f5-host\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.949206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea40ee70-811f-4e27-9e83-fb970c84312b-socket-dir\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.949339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba50a4c5-bdd8-4295-8285-999519a9e53e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.949342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-host-cni-netd\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.950626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.949361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2d1da7a-f169-4354-906a-a3d825d1c2f5-serviceca\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.953282 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.953187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-ovn-node-metrics-cert\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.959023 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.958481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5njqd\" (UniqueName: \"kubernetes.io/projected/12b2765d-53b9-4f4a-b4e6-88bd94cde305-kube-api-access-5njqd\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:16.960331 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.960270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvgzx\" (UniqueName: \"kubernetes.io/projected/1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277-kube-api-access-nvgzx\") pod \"ovnkube-node-z9pvd\" (UID: \"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:16.961550 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.961509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zsjs\" (UniqueName: \"kubernetes.io/projected/e2d1da7a-f169-4354-906a-a3d825d1c2f5-kube-api-access-6zsjs\") pod \"node-ca-wsnqw\" (UID: \"e2d1da7a-f169-4354-906a-a3d825d1c2f5\") " pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:16.963238 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.963199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mkk4\" (UniqueName: \"kubernetes.io/projected/ba50a4c5-bdd8-4295-8285-999519a9e53e-kube-api-access-9mkk4\") pod \"multus-additional-cni-plugins-wpf8t\" (UID: \"ba50a4c5-bdd8-4295-8285-999519a9e53e\") " pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:16.964070 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.963753 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:16.964070 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.963777 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:16.964070 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.963798 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:16.964070 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:16.963887 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:17.463868134 +0000 UTC m=+2.999158551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:16.970501 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.970117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kwq5\" (UniqueName: \"kubernetes.io/projected/ea40ee70-811f-4e27-9e83-fb970c84312b-kube-api-access-2kwq5\") pod \"aws-ebs-csi-driver-node-95xrf\" (UID: \"ea40ee70-811f-4e27-9e83-fb970c84312b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:16.971479 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:16.971438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn26x\" (UniqueName: \"kubernetes.io/projected/ae6e244c-2600-44bd-ba30-7550176e8a53-kube-api-access-fn26x\") pod \"node-resolver-jtdkf\" (UID: \"ae6e244c-2600-44bd-ba30-7550176e8a53\") " pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:17.049688 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-modprobe-d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-socket-dir-parent\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-netns\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-daemon-config\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-sys\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-cni-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-cni-multus\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.049855 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-conf-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-var-lib-kubelet\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98bebf84-ada9-4d90-b385-f95c02c8a683-agent-certs\") pod \"konnectivity-agent-nmzfr\" (UID: \"98bebf84-ada9-4d90-b385-f95c02c8a683\") " pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-hostroot\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjwbj\" (UniqueName: \"kubernetes.io/projected/c882f671-340a-49e9-86d2-9bb0d8c75658-kube-api-access-kjwbj\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.049985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-iptables-alerter-script\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysctl-d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-cni-bin\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-host-slash\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-kubernetes\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-systemd\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-lib-modules\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkk9h\" (UniqueName: \"kubernetes.io/projected/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-kube-api-access-fkk9h\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l558d\" (UniqueName: \"kubernetes.io/projected/ae959d92-64f2-40bd-92b1-55365ec3e889-kube-api-access-l558d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050241 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-os-release\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae959d92-64f2-40bd-92b1-55365ec3e889-tmp\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysctl-conf\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-host\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-system-cni-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-cnibin\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-k8s-cni-cncf-io\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-kubelet\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98bebf84-ada9-4d90-b385-f95c02c8a683-konnectivity-ca\") pod \"konnectivity-agent-nmzfr\" (UID: \"98bebf84-ada9-4d90-b385-f95c02c8a683\") " pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysconfig\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c882f671-340a-49e9-86d2-9bb0d8c75658-cni-binary-copy\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-multus-certs\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-etc-kubernetes\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-run\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-tuned\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-systemd\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.050933 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-modprobe-d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.050980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-socket-dir-parent\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-netns\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-cnibin\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-lib-modules\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-daemon-config\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-sys\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.051660 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-cni-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051998 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-cni-multus\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051998 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-multus-conf-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051998 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-os-release\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.051998 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-var-lib-kubelet\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.051998 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-host\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.051998 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.051862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-system-cni-dir\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052279 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-hostroot\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052279 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysconfig\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.052279 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-k8s-cni-cncf-io\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052279 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-kubelet\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052461 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-run-multus-certs\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052461 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-iptables-alerter-script\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-host-var-lib-cni-bin\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052652 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-host-slash\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-kubernetes\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysctl-d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c882f671-340a-49e9-86d2-9bb0d8c75658-etc-kubernetes\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98bebf84-ada9-4d90-b385-f95c02c8a683-konnectivity-ca\") pod \"konnectivity-agent-nmzfr\" (UID: \"98bebf84-ada9-4d90-b385-f95c02c8a683\") " pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:17.052811 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-run\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.053261 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.052838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c882f671-340a-49e9-86d2-9bb0d8c75658-cni-binary-copy\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.053261 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.053007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-sysctl-conf\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.055446 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.055405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae959d92-64f2-40bd-92b1-55365ec3e889-tmp\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.055820 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.055801 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae959d92-64f2-40bd-92b1-55365ec3e889-etc-tuned\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.057415 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.057375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98bebf84-ada9-4d90-b385-f95c02c8a683-agent-certs\") pod \"konnectivity-agent-nmzfr\" (UID: \"98bebf84-ada9-4d90-b385-f95c02c8a683\") " pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:17.075742 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.075675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l558d\" (UniqueName: \"kubernetes.io/projected/ae959d92-64f2-40bd-92b1-55365ec3e889-kube-api-access-l558d\") pod \"tuned-pd2wh\" (UID: \"ae959d92-64f2-40bd-92b1-55365ec3e889\") " pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.076245 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.076222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjwbj\" (UniqueName: \"kubernetes.io/projected/c882f671-340a-49e9-86d2-9bb0d8c75658-kube-api-access-kjwbj\") pod \"multus-9k7tj\" (UID: \"c882f671-340a-49e9-86d2-9bb0d8c75658\") " pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.078558 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.078507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkk9h\" (UniqueName: \"kubernetes.io/projected/24a154ab-5f3e-4124-99ad-8c63f1c5c31f-kube-api-access-fkk9h\") pod \"iptables-alerter-9bxrr\" (UID: \"24a154ab-5f3e-4124-99ad-8c63f1c5c31f\") " pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.138060 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.138027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jtdkf" Jul 01 16:58:17.147566 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.147530 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6e244c_2600_44bd_ba30_7550176e8a53.slice/crio-5d756f22e2c4a7eb8f822b72a7c9a58cbd4ef585955ad95160c1d1ca15a049cf WatchSource:0}: Error finding container 5d756f22e2c4a7eb8f822b72a7c9a58cbd4ef585955ad95160c1d1ca15a049cf: Status 404 returned error can't find the container with id 5d756f22e2c4a7eb8f822b72a7c9a58cbd4ef585955ad95160c1d1ca15a049cf Jul 01 16:58:17.148515 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.148423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" Jul 01 16:58:17.156799 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.156773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsnqw" Jul 01 16:58:17.157399 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.157368 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea40ee70_811f_4e27_9e83_fb970c84312b.slice/crio-15d611cc9f68a262daa69c77a384aafbf41ac4cb71c4e7cda9399f4ce0726323 WatchSource:0}: Error finding container 15d611cc9f68a262daa69c77a384aafbf41ac4cb71c4e7cda9399f4ce0726323: Status 404 returned error can't find the container with id 15d611cc9f68a262daa69c77a384aafbf41ac4cb71c4e7cda9399f4ce0726323 Jul 01 16:58:17.161135 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.161115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:17.165774 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.165747 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d1da7a_f169_4354_906a_a3d825d1c2f5.slice/crio-c450f0cdfcb57d68b5b3b4b63d5c0bf832015f08cacae8c74b0919795827f4ea WatchSource:0}: Error finding container c450f0cdfcb57d68b5b3b4b63d5c0bf832015f08cacae8c74b0919795827f4ea: Status 404 returned error can't find the container with id c450f0cdfcb57d68b5b3b4b63d5c0bf832015f08cacae8c74b0919795827f4ea Jul 01 16:58:17.168043 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.167809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" Jul 01 16:58:17.177302 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.177273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bxrr" Jul 01 16:58:17.181699 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.181672 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba50a4c5_bdd8_4295_8285_999519a9e53e.slice/crio-c74df370804e8be4f6913645c5e9b42efccc907172a54be149569ea77cad7822 WatchSource:0}: Error finding container c74df370804e8be4f6913645c5e9b42efccc907172a54be149569ea77cad7822: Status 404 returned error can't find the container with id c74df370804e8be4f6913645c5e9b42efccc907172a54be149569ea77cad7822 Jul 01 16:58:17.184508 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.184484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" Jul 01 16:58:17.188160 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.188125 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a154ab_5f3e_4124_99ad_8c63f1c5c31f.slice/crio-7007e8d6bb9c7033950a88dbcfb09069a68d3cc4f95137c5d9a266d5580f5678 WatchSource:0}: Error finding container 7007e8d6bb9c7033950a88dbcfb09069a68d3cc4f95137c5d9a266d5580f5678: Status 404 returned error can't find the container with id 7007e8d6bb9c7033950a88dbcfb09069a68d3cc4f95137c5d9a266d5580f5678 Jul 01 16:58:17.192446 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.192251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:17.195131 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.194929 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae959d92_64f2_40bd_92b1_55365ec3e889.slice/crio-68d9a9d815a3a9dacf98cc91d407d80e9bf58e0c6ff73225a91ca8f35fc632db WatchSource:0}: Error finding container 68d9a9d815a3a9dacf98cc91d407d80e9bf58e0c6ff73225a91ca8f35fc632db: Status 404 returned error can't find the container with id 68d9a9d815a3a9dacf98cc91d407d80e9bf58e0c6ff73225a91ca8f35fc632db Jul 01 16:58:17.199134 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.199114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9k7tj" Jul 01 16:58:17.202559 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.202532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bebf84_ada9_4d90_b385_f95c02c8a683.slice/crio-ed7e457577946652fb63f8362d375eda7ea83bbf2bb05215785117f42810043b WatchSource:0}: Error finding container ed7e457577946652fb63f8362d375eda7ea83bbf2bb05215785117f42810043b: Status 404 returned error can't find the container with id ed7e457577946652fb63f8362d375eda7ea83bbf2bb05215785117f42810043b Jul 01 16:58:17.208906 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:17.208883 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc882f671_340a_49e9_86d2_9bb0d8c75658.slice/crio-db849e61b590aa4f5958f761693d03f2c28ffe9fa7763b308c5e6b604e72c03e WatchSource:0}: Error finding container db849e61b590aa4f5958f761693d03f2c28ffe9fa7763b308c5e6b604e72c03e: Status 404 returned error can't find the container with id db849e61b590aa4f5958f761693d03f2c28ffe9fa7763b308c5e6b604e72c03e Jul 01 16:58:17.454266 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.454191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:17.454266 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.454232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:17.454478 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.454353 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:17.454478 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.454356 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:17.454478 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.454401 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:18.454388163 +0000 UTC m=+3.989678565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:17.454478 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.454414 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:18.454407815 +0000 UTC m=+3.989698216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:17.554533 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.554496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:17.554703 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.554672 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:17.554703 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.554698 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:17.554834 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.554711 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:17.554834 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.554757 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:18.554743164 +0000 UTC m=+4.090033565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:17.902905 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.902819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:17.903525 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:17.902980 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:17.907095 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.906997 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:53:16 +0000 UTC" deadline="2027-12-30 05:59:31.986838407 +0000 UTC" Jul 01 16:58:17.907095 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.907047 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13117h1m14.079795384s" Jul 01 16:58:17.915139 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.915080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsnqw" event={"ID":"e2d1da7a-f169-4354-906a-a3d825d1c2f5","Type":"ContainerStarted","Data":"c450f0cdfcb57d68b5b3b4b63d5c0bf832015f08cacae8c74b0919795827f4ea"} Jul 01 16:58:17.916768 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.916736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"98537733a2a04deed00c671508c033697103027364280d1fac33e975ae798ad8"} Jul 01 16:58:17.918864 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.918822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" event={"ID":"ea40ee70-811f-4e27-9e83-fb970c84312b","Type":"ContainerStarted","Data":"15d611cc9f68a262daa69c77a384aafbf41ac4cb71c4e7cda9399f4ce0726323"} Jul 01 16:58:17.920581 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.920555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jtdkf" event={"ID":"ae6e244c-2600-44bd-ba30-7550176e8a53","Type":"ContainerStarted","Data":"5d756f22e2c4a7eb8f822b72a7c9a58cbd4ef585955ad95160c1d1ca15a049cf"} Jul 01 16:58:17.921935 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.921882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9k7tj" event={"ID":"c882f671-340a-49e9-86d2-9bb0d8c75658","Type":"ContainerStarted","Data":"db849e61b590aa4f5958f761693d03f2c28ffe9fa7763b308c5e6b604e72c03e"} Jul 01 16:58:17.923059 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.923036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nmzfr" event={"ID":"98bebf84-ada9-4d90-b385-f95c02c8a683","Type":"ContainerStarted","Data":"ed7e457577946652fb63f8362d375eda7ea83bbf2bb05215785117f42810043b"} Jul 01 16:58:17.924435 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.924413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" event={"ID":"ae959d92-64f2-40bd-92b1-55365ec3e889","Type":"ContainerStarted","Data":"68d9a9d815a3a9dacf98cc91d407d80e9bf58e0c6ff73225a91ca8f35fc632db"} Jul 01 16:58:17.925901 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.925870 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bxrr" event={"ID":"24a154ab-5f3e-4124-99ad-8c63f1c5c31f","Type":"ContainerStarted","Data":"7007e8d6bb9c7033950a88dbcfb09069a68d3cc4f95137c5d9a266d5580f5678"} Jul 01 16:58:17.927353 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:17.927315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerStarted","Data":"c74df370804e8be4f6913645c5e9b42efccc907172a54be149569ea77cad7822"} Jul 01 16:58:18.465002 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.464232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:18.465002 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.464295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:18.465002 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.464440 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:18.465002 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.464499 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:20.464481932 +0000 UTC m=+5.999772338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:18.465002 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.464901 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:18.465002 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.464951 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:20.464935783 +0000 UTC m=+6.000226200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:18.565383 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.565342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:18.565571 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.565539 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:18.565571 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.565563 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:18.565684 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.565576 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:18.565684 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.565648 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:20.565617278 +0000 UTC m=+6.100907699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:18.909017 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.908174 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:53:16 +0000 UTC" deadline="2027-11-29 03:27:04.906568382 +0000 UTC" Jul 01 16:58:18.909017 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.908415 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12370h28m45.998160742s" Jul 01 16:58:18.909017 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.908507 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:18.909017 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.908615 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:18.911609 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:18.909815 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:18.911609 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:18.909937 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:19.903546 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:19.903508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:19.903716 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:19.903639 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:19.946073 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:19.946031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" event={"ID":"46679bc7f7ce1d9afc659dfd5f23d201","Type":"ContainerStarted","Data":"9f143e2f8b153c5492d56af514a427bf2b73170fdcb6c6d62c1495beec06f7ce"} Jul 01 16:58:19.951836 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:19.951804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"4f36dc18b292c3718a761252503d2644","Type":"ContainerStarted","Data":"686e5fa9ba862ab10465f3866f76665965e631f08c8ff61f0a322762dbdd5c15"} Jul 01 16:58:19.981084 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:19.981024 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" podStartSLOduration=3.981001327 podStartE2EDuration="3.981001327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:19.963424051 +0000 UTC m=+5.498714468" watchObservedRunningTime="2026-07-01 16:58:19.981001327 +0000 UTC m=+5.516291752" Jul 01 16:58:20.483445 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:20.483410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:20.483648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:20.483473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:20.483648 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.483606 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:20.483771 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.483669 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:24.483650988 +0000 UTC m=+10.018941389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:20.484161 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.484140 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:20.484266 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.484199 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:24.484181798 +0000 UTC m=+10.019472204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:20.584525 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:20.583859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:20.584525 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.584048 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:20.584525 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.584071 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:20.584525 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.584083 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:20.584525 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.584141 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:24.584122588 +0000 UTC m=+10.119413009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:20.903786 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:20.903706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:20.903933 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.903852 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:20.904372 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:20.904270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:20.904468 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:20.904424 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:21.903635 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:21.903604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:21.904069 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:21.903731 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:21.960611 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:21.960515 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f36dc18b292c3718a761252503d2644" containerID="686e5fa9ba862ab10465f3866f76665965e631f08c8ff61f0a322762dbdd5c15" exitCode=0 Jul 01 16:58:21.960611 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:21.960566 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"4f36dc18b292c3718a761252503d2644","Type":"ContainerDied","Data":"686e5fa9ba862ab10465f3866f76665965e631f08c8ff61f0a322762dbdd5c15"} Jul 01 16:58:22.903453 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:22.903417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:22.903622 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:22.903566 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:22.903735 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:22.903713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:22.904093 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:22.903822 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:23.903531 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:23.903486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:23.903731 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:23.903626 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:24.516987 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:24.516931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:24.517446 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:24.517051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:24.517446 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.517100 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:24.517446 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.517136 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:24.517446 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.517184 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:32.517162858 +0000 UTC m=+18.052453279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:24.517446 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.517205 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:32.517194543 +0000 UTC m=+18.052484959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:24.617987 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:24.617940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:24.618183 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.618139 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:24.618183 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.618168 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:24.618183 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.618182 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:24.618339 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.618251 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:32.618231046 +0000 UTC m=+18.153521461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:24.905736 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:24.905308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:24.905736 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.905396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:24.905736 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:24.905407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:24.905736 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:24.905537 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:25.903799 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:25.903723 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:25.904275 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:25.903865 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:26.903729 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:26.903695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:26.903883 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:26.903708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:26.903883 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:26.903821 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:26.904335 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:26.903920 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:27.902879 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:27.902797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:27.903070 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:27.902920 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:28.903747 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:28.903713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:28.904210 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:28.903765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:28.904210 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:28.903862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:28.904210 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:28.904006 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:29.903424 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:29.903385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:29.903593 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:29.903514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:30.903137 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:30.903102 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:30.903510 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:30.903106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:30.903510 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:30.903243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:30.903510 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:30.903287 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:31.902971 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:31.902881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:31.903174 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:31.903004 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:32.585770 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:32.585730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:32.586062 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:32.585826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:32.586062 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.585868 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:32.586062 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.585919 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:32.586062 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.585943 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:48.585921804 +0000 UTC m=+34.121212216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:32.586062 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.585988 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:48.585972165 +0000 UTC m=+34.121262574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:32.686656 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:32.686618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:32.686841 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.686800 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:32.686841 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.686820 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:32.686841 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.686830 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:32.686979 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.686889 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:48.686871606 +0000 UTC m=+34.222162017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:32.903419 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:32.903333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:32.903851 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.903484 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:32.903851 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:32.903561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:32.903851 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:32.903670 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:33.903676 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:33.903641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:33.904108 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:33.903753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:34.903578 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:34.903540 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:34.903771 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:34.903678 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:34.903771 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:34.903706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:34.904217 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:34.903824 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:35.903606 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:35.903574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:35.903762 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:35.903684 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:36.903865 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.903463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:36.904615 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.903469 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:36.904615 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:36.904004 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:36.904615 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:36.904054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:36.990194 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.990160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsnqw" event={"ID":"e2d1da7a-f169-4354-906a-a3d825d1c2f5","Type":"ContainerStarted","Data":"8fc5bc1c5575a2b64ca8b18353e5ffc3e42c3b91afa30555852f3eb3c5d583e1"} Jul 01 16:58:36.992552 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.992530 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 16:58:36.992927 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.992907 2577 generic.go:356] "Generic (PLEG): container finished" podID="1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277" containerID="1bded3c35dfd5de89369263c7d0e5cf7053492dad96a89613408e3e8b8a7740b" exitCode=1 Jul 01 16:58:36.993041 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.992979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"26551f60c031447f0798f27e6fe7144fb6bb10cb1140f7b1a1d424655d71346e"} Jul 01 16:58:36.993105 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.993085 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"9f3bc62a1923b012ac622719a5ab1f323cae80165bd45f41e96588aba0c2297d"} Jul 01 16:58:36.993161 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.993138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerDied","Data":"1bded3c35dfd5de89369263c7d0e5cf7053492dad96a89613408e3e8b8a7740b"} Jul 01 16:58:36.993246 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.993228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"51b2139bdcf227a2191b2bb80e7654af2d1ef70deac386081e04c316f8fa923e"} Jul 01 16:58:36.994553 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.994518 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" event={"ID":"ea40ee70-811f-4e27-9e83-fb970c84312b","Type":"ContainerStarted","Data":"cbd95306cbbc5d1da92008f48b4aeb38080953d8e52f00eb17a0c000a07769df"} Jul 01 16:58:36.996088 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.996062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jtdkf" event={"ID":"ae6e244c-2600-44bd-ba30-7550176e8a53","Type":"ContainerStarted","Data":"b3ecc94e2243045449716a7c263d134468e2e23dcf17da68b8ad65e60ccfa7b0"} Jul 01 16:58:36.998368 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:36.998347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"4f36dc18b292c3718a761252503d2644","Type":"ContainerStarted","Data":"28c06287bb243eeb783519a36e1fd93f0d9ce625abe7d92863a130af9bd93464"} Jul 01 16:58:37.000058 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.000026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9k7tj" event={"ID":"c882f671-340a-49e9-86d2-9bb0d8c75658","Type":"ContainerStarted","Data":"f31f9e89e3c6a9892bd30c69c8c5d2bb8db4e32077742e581f57fcde343a8d32"} Jul 01 16:58:37.001692 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.001667 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nmzfr" event={"ID":"98bebf84-ada9-4d90-b385-f95c02c8a683","Type":"ContainerStarted","Data":"39189203667a5219a42a7d0d578720b36177e567080a4f8217b95715106995f1"} Jul 01 16:58:37.003310 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.003289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" event={"ID":"ae959d92-64f2-40bd-92b1-55365ec3e889","Type":"ContainerStarted","Data":"a682bf8206ba4ede698a9b0bd7af846c651e12db7d54fff6cf43bd75e61afa2f"} Jul 01 16:58:37.004827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.004805 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba50a4c5-bdd8-4295-8285-999519a9e53e" containerID="c7d952621e9e4448c53554d96d89e2401057e275b09b602c3839da9b49290dd7" exitCode=0 Jul 01 16:58:37.004913 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.004839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerDied","Data":"c7d952621e9e4448c53554d96d89e2401057e275b09b602c3839da9b49290dd7"} Jul 01 16:58:37.007518 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.007483 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wsnqw" podStartSLOduration=3.256995663 podStartE2EDuration="22.007472657s" totalImagesPullingTime="18.750476994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:37.007226739 +0000 UTC m=+22.542517163" watchObservedRunningTime="2026-07-01 16:58:37.007472657 +0000 UTC m=+22.542763081" Jul 01 16:58:37.051101 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.051053 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pd2wh" podStartSLOduration=3.330298064 podStartE2EDuration="22.051037384s" totalImagesPullingTime="18.72073932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:37.051013193 +0000 UTC m=+22.586303619" watchObservedRunningTime="2026-07-01 16:58:37.051037384 +0000 UTC m=+22.586327837" Jul 01 16:58:37.070136 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.070082 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9k7tj" podStartSLOduration=3.319560655 podStartE2EDuration="22.070066094s" totalImagesPullingTime="18.750505439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:37.069951033 +0000 UTC m=+22.605241467" watchObservedRunningTime="2026-07-01 16:58:37.070066094 +0000 UTC m=+22.605356518" Jul 01 16:58:37.106224 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.104467 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" podStartSLOduration=21.104444586 podStartE2EDuration="21.104444586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:37.087095863 +0000 UTC m=+22.622386287" watchObservedRunningTime="2026-07-01 16:58:37.104444586 +0000 UTC m=+22.639735011" Jul 01 16:58:37.120476 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.120425 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jtdkf" podStartSLOduration=3.350974848 podStartE2EDuration="22.120406338s" totalImagesPullingTime="18.76943149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:37.10393057 +0000 UTC m=+22.639221014" watchObservedRunningTime="2026-07-01 16:58:37.120406338 +0000 UTC m=+22.655696764" Jul 01 16:58:37.120774 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.120738 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nmzfr" podStartSLOduration=3.408169635 podStartE2EDuration="22.120730268s" totalImagesPullingTime="18.712560633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:37.120622344 +0000 UTC m=+22.655912797" watchObservedRunningTime="2026-07-01 16:58:37.120730268 +0000 UTC m=+22.656020717" Jul 01 16:58:37.578639 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.578613 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:58:37.903830 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.903746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:37.904018 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:37.903872 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:37.904442 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.904209 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:58:37.578633198Z","UUID":"b2dc3e39-cb70-4113-8b0e-5df07c16fa3c","Handler":null,"Name":"","Endpoint":""} Jul 01 16:58:37.905777 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.905756 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:58:37.905890 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:37.905799 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:58:38.008721 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.008685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bxrr" event={"ID":"24a154ab-5f3e-4124-99ad-8c63f1c5c31f","Type":"ContainerStarted","Data":"a7010797dec7c648b38e25e7bb2662d8a3581219a54158eb7787032d7779bba7"} Jul 01 16:58:38.011777 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.011751 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 16:58:38.012227 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.012203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"bc78b2aee7d4af200200ecdd85e5457dbde4b8bc1510d756841f0a3e46ad1869"} Jul 01 16:58:38.012326 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.012282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"fed4a0b785699b2df23cf0be512e13a11ef3da116e278eca52a9202d73056eaa"} Jul 01 16:58:38.016538 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.016476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" event={"ID":"ea40ee70-811f-4e27-9e83-fb970c84312b","Type":"ContainerStarted","Data":"5ed5a2871757867b8032c97979f4c4d68ae9d95667af0570b655bcd71e053f1b"} Jul 01 16:58:38.029400 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.029353 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9bxrr" podStartSLOduration=4.301044117 podStartE2EDuration="23.02933388s" totalImagesPullingTime="18.728289763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:38.027817877 +0000 UTC m=+23.563108301" watchObservedRunningTime="2026-07-01 16:58:38.02933388 +0000 UTC m=+23.564624307" Jul 01 16:58:38.903494 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.903418 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:38.903756 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:38.903418 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:38.903756 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:38.903562 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:38.903756 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:38.903608 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:39.025193 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:39.025153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" event={"ID":"ea40ee70-811f-4e27-9e83-fb970c84312b","Type":"ContainerStarted","Data":"2af1566c4f978a4b7028747ba29b2a2889a6b93f4488cee6f8b5afb621ede336"} Jul 01 16:58:39.903368 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:39.903339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:39.903549 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:39.903438 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:40.031180 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:40.031152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 16:58:40.031618 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:40.031524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"0d9faffa85ee3f216bd9ad94452d81ca984a2bbd3d33bba85bd49118b514d3cd"} Jul 01 16:58:40.903041 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:40.902832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:40.903222 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:40.902938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:40.903222 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:40.903132 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:40.903349 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:40.903243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:41.384028 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:41.383819 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:41.384449 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:41.384435 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:41.413260 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:41.413217 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95xrf" podStartSLOduration=5.406774975 podStartE2EDuration="26.413199122s" totalImagesPullingTime="21.006424147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:39.04687888 +0000 UTC m=+24.582169334" watchObservedRunningTime="2026-07-01 16:58:41.413199122 +0000 UTC m=+26.948489545" Jul 01 16:58:41.903211 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:41.903126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:41.903375 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:41.903236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:42.041930 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.041901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 16:58:42.042357 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.042332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"e55057bb6bb01a94b62cf3378e7f7f5e61e96709dd1cb4874bca2811a9b71927"} Jul 01 16:58:42.042551 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.042535 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:42.042634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.042585 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:42.042874 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.042753 2577 scope.go:117] "RemoveContainer" containerID="1bded3c35dfd5de89369263c7d0e5cf7053492dad96a89613408e3e8b8a7740b" Jul 01 16:58:42.044531 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.044385 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba50a4c5-bdd8-4295-8285-999519a9e53e" containerID="c0a3253df5a22881bce9e7078389999ee55fd82de49bffb986be05c02516c271" exitCode=0 Jul 01 16:58:42.044631 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.044442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerDied","Data":"c0a3253df5a22881bce9e7078389999ee55fd82de49bffb986be05c02516c271"} Jul 01 16:58:42.044898 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.044859 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:42.045399 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.045380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nmzfr" Jul 01 16:58:42.059448 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.059422 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:42.059663 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.059650 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:42.903049 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.903011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:42.903705 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:42.903011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:42.903705 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:42.903167 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:42.903705 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:42.903198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:43.049765 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.049689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 16:58:43.050061 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.050028 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" event={"ID":"1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277","Type":"ContainerStarted","Data":"53053103ddcc89fbbd4175a4802ec14987e5b07a92bf927f9cf986b87249842d"} Jul 01 16:58:43.050132 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.050116 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 16:58:43.095535 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.095480 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" podStartSLOduration=8.796456809 podStartE2EDuration="28.095463378s" totalImagesPullingTime="19.299006569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:43.094922873 +0000 UTC m=+28.630213297" watchObservedRunningTime="2026-07-01 16:58:43.095463378 +0000 UTC m=+28.630753803" Jul 01 16:58:43.743630 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.743473 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-26c5b"] Jul 01 16:58:43.743834 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.743650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:43.743834 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:43.743776 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:43.747919 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.747883 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mcrjd"] Jul 01 16:58:43.748058 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.748013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:43.748122 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:43.748103 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:43.748451 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.748427 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxxg6"] Jul 01 16:58:43.748556 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:43.748527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:43.748628 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:43.748608 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:44.054737 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:44.054657 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba50a4c5-bdd8-4295-8285-999519a9e53e" containerID="919f09eb2b07675673b1b9c8772f23b36992fdca4197606f73cfa0b4d4028a8d" exitCode=0 Jul 01 16:58:44.055135 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:44.054738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerDied","Data":"919f09eb2b07675673b1b9c8772f23b36992fdca4197606f73cfa0b4d4028a8d"} Jul 01 16:58:44.055135 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:44.054858 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 16:58:44.903805 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:44.903624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:44.903990 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:44.903873 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:45.861038 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:45.861005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:58:45.903226 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:45.903146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:45.903373 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:45.903260 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:45.903373 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:45.903292 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:45.903373 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:45.903346 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:46.062465 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:46.062436 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba50a4c5-bdd8-4295-8285-999519a9e53e" containerID="cdd1635b5bce09ab15419c8d8c425beb7fed126b894f79a90e8a5ee2adce2c62" exitCode=0 Jul 01 16:58:46.062596 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:46.062474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerDied","Data":"cdd1635b5bce09ab15419c8d8c425beb7fed126b894f79a90e8a5ee2adce2c62"} Jul 01 16:58:46.903296 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:46.903260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:46.903864 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:46.903404 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:47.903032 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:47.902985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:47.903216 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:47.903003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:47.903216 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:47.903130 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcrjd" podUID="12b2765d-53b9-4f4a-b4e6-88bd94cde305" Jul 01 16:58:47.903216 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:47.903166 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxxg6" podUID="86bc2c27-afb4-40f9-af3c-9fe2d4a01837" Jul 01 16:58:48.602588 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:48.602549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:48.603042 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:48.602599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:48.603042 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.602702 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:48.603042 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.602768 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:20.602751317 +0000 UTC m=+66.138041722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:48.603042 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.602706 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:48.603042 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.602834 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret podName:4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:20.602821237 +0000 UTC m=+66.138111665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret") pod "global-pull-secret-syncer-26c5b" (UID: "4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:48.703808 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:48.703770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:48.703996 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.703950 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:48.703996 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.703993 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:48.704118 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.704008 2577 projected.go:196] Error preparing data for projected volume kube-api-access-gnkpp for pod openshift-network-diagnostics/network-check-target-wxxg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:48.704118 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.704074 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp podName:86bc2c27-afb4-40f9-af3c-9fe2d4a01837 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:20.704053397 +0000 UTC m=+66.239343815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnkpp" (UniqueName: "kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp") pod "network-check-target-wxxg6" (UID: "86bc2c27-afb4-40f9-af3c-9fe2d4a01837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:48.903133 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:48.903051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:48.903292 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:48.903167 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26c5b" podUID="4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a" Jul 01 16:58:49.739227 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.739200 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeReady" Jul 01 16:58:49.739621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.739357 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:58:49.827684 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.827652 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6gl52"] Jul 01 16:58:49.830318 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.830297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:49.833840 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.833817 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:58:49.833981 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.833935 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shlnm\"" Jul 01 16:58:49.834288 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.834272 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:58:49.879269 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.879233 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6pv6w"] Jul 01 16:58:49.881577 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.881550 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gl52"] Jul 01 16:58:49.881709 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.881651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:49.892745 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.892724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:58:49.892895 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.892790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9cnfg\"" Jul 01 16:58:49.893150 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.893131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:58:49.893408 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.893388 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:58:49.903646 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.903588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:58:49.903761 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.903588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:58:49.911508 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.911486 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sw8bs\"" Jul 01 16:58:49.911508 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.911499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8njwh\"" Jul 01 16:58:49.911689 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.911556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:58:49.911743 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.911715 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:58:49.912319 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.912299 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:58:49.914519 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.914501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:49.914617 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.914559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqs62\" (UniqueName: \"kubernetes.io/projected/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-kube-api-access-lqs62\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:49.914617 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.914589 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-config-volume\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:49.914732 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.914615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-tmp-dir\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:49.919536 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:49.919517 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6pv6w"] Jul 01 16:58:50.015769 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.015725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.015948 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.015783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e7ad64-cc0f-4dff-b921-0101a0f158a7-cert\") pod \"ingress-canary-6pv6w\" (UID: \"90e7ad64-cc0f-4dff-b921-0101a0f158a7\") " pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.015948 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.015812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2mcd\" (UniqueName: \"kubernetes.io/projected/90e7ad64-cc0f-4dff-b921-0101a0f158a7-kube-api-access-m2mcd\") pod \"ingress-canary-6pv6w\" (UID: \"90e7ad64-cc0f-4dff-b921-0101a0f158a7\") " pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.015948 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:50.015878 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:58:50.015948 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.015901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqs62\" (UniqueName: \"kubernetes.io/projected/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-kube-api-access-lqs62\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.015948 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.015934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-config-volume\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.015948 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:50.015948 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:58:50.515930378 +0000 UTC m=+36.051220783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:58:50.016210 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.016000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-tmp-dir\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.016344 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.016323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-tmp-dir\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.016571 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.016537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-config-volume\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.057363 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.057331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqs62\" (UniqueName: \"kubernetes.io/projected/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-kube-api-access-lqs62\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.116908 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.116846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e7ad64-cc0f-4dff-b921-0101a0f158a7-cert\") pod \"ingress-canary-6pv6w\" (UID: \"90e7ad64-cc0f-4dff-b921-0101a0f158a7\") " pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.116908 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.116894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2mcd\" (UniqueName: \"kubernetes.io/projected/90e7ad64-cc0f-4dff-b921-0101a0f158a7-kube-api-access-m2mcd\") pod \"ingress-canary-6pv6w\" (UID: \"90e7ad64-cc0f-4dff-b921-0101a0f158a7\") " pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.119634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.119611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e7ad64-cc0f-4dff-b921-0101a0f158a7-cert\") pod \"ingress-canary-6pv6w\" (UID: \"90e7ad64-cc0f-4dff-b921-0101a0f158a7\") " pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.130940 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.130884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2mcd\" (UniqueName: \"kubernetes.io/projected/90e7ad64-cc0f-4dff-b921-0101a0f158a7-kube-api-access-m2mcd\") pod \"ingress-canary-6pv6w\" (UID: \"90e7ad64-cc0f-4dff-b921-0101a0f158a7\") " pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.190887 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.190811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6pv6w" Jul 01 16:58:50.520287 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.520246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:50.520471 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:50.520415 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:58:50.520544 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:50.520487 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:58:51.520466307 +0000 UTC m=+37.055756722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:58:50.904000 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.903736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:58:50.908396 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:50.908374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:58:51.077047 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:51.076798 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6pv6w"] Jul 01 16:58:51.077481 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:51.077451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerStarted","Data":"24b76985fa20c1aa4a9130d760749bd96fa3096786667a54695b3eeb5f39e895"} Jul 01 16:58:51.081104 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:58:51.081080 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e7ad64_cc0f_4dff_b921_0101a0f158a7.slice/crio-416aad3b704ecfcce1dc4d3703deb1d85ecb8a5504b2674d389a39b43aa183d8 WatchSource:0}: Error finding container 416aad3b704ecfcce1dc4d3703deb1d85ecb8a5504b2674d389a39b43aa183d8: Status 404 returned error can't find the container with id 416aad3b704ecfcce1dc4d3703deb1d85ecb8a5504b2674d389a39b43aa183d8 Jul 01 16:58:51.527081 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:51.527044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:51.527220 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:51.527189 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:58:51.527254 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:51.527249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:58:53.527233368 +0000 UTC m=+39.062523773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:58:52.083087 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:52.083057 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba50a4c5-bdd8-4295-8285-999519a9e53e" containerID="24b76985fa20c1aa4a9130d760749bd96fa3096786667a54695b3eeb5f39e895" exitCode=0 Jul 01 16:58:52.083560 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:52.083138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerDied","Data":"24b76985fa20c1aa4a9130d760749bd96fa3096786667a54695b3eeb5f39e895"} Jul 01 16:58:52.084396 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:52.084199 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6pv6w" event={"ID":"90e7ad64-cc0f-4dff-b921-0101a0f158a7","Type":"ContainerStarted","Data":"416aad3b704ecfcce1dc4d3703deb1d85ecb8a5504b2674d389a39b43aa183d8"} Jul 01 16:58:53.090095 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:53.090063 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba50a4c5-bdd8-4295-8285-999519a9e53e" containerID="2c37c6a18b24cc778db03f1862240666b8009de4a9692f21ec85af0785eaa37c" exitCode=0 Jul 01 16:58:53.090502 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:53.090142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerDied","Data":"2c37c6a18b24cc778db03f1862240666b8009de4a9692f21ec85af0785eaa37c"} Jul 01 16:58:53.543584 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:53.543353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:53.543766 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:53.543508 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:58:53.543766 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:53.543674 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:58:57.543652826 +0000 UTC m=+43.078943254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:58:54.093800 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:54.093767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6pv6w" event={"ID":"90e7ad64-cc0f-4dff-b921-0101a0f158a7","Type":"ContainerStarted","Data":"d3d69bc24df6c99488f751d5413a2bf59c0368f05b799d9ffd8a69293ab5f590"} Jul 01 16:58:54.096934 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:54.096911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" event={"ID":"ba50a4c5-bdd8-4295-8285-999519a9e53e","Type":"ContainerStarted","Data":"a3d8ade0cc0387172305eba73db4436ef83c68f342903f758ff4e17d0b241f2a"} Jul 01 16:58:54.118027 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:54.117987 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6pv6w" podStartSLOduration=2.530278907 podStartE2EDuration="5.11797237s" totalImagesPullingTime="2.587693463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:54.117230533 +0000 UTC m=+39.652520959" watchObservedRunningTime="2026-07-01 16:58:54.11797237 +0000 UTC m=+39.653262785" Jul 01 16:58:54.146652 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:54.146597 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wpf8t" podStartSLOduration=9.071761425 podStartE2EDuration="39.146578053s" totalImagesPullingTime="30.074816628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:54.146385496 +0000 UTC m=+39.681675921" watchObservedRunningTime="2026-07-01 16:58:54.146578053 +0000 UTC m=+39.681868477" Jul 01 16:58:57.574076 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:58:57.574034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:58:57.574497 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:57.574210 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:58:57.574497 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:58:57.574279 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:59:05.574262662 +0000 UTC m=+51.109553069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:59:05.304131 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.304096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m"] Jul 01 16:59:05.321713 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.321684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:05.326578 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.326552 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 16:59:05.326742 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.326629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dzb9s\"" Jul 01 16:59:05.327565 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.327544 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:59:05.327657 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.327596 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 16:59:05.350477 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.350448 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m"] Jul 01 16:59:05.354421 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.354400 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc"] Jul 01 16:59:05.375719 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.375692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.382049 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.382030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 16:59:05.382490 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.382476 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 16:59:05.386533 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.386515 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rfnvg\"" Jul 01 16:59:05.390076 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.390062 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:59:05.390141 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.390098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 16:59:05.413492 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.413465 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc"] Jul 01 16:59:05.433200 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.433170 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-m6kh4"] Jul 01 16:59:05.434620 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.434601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:05.434688 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.434639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frtx4\" (UniqueName: \"kubernetes.io/projected/92fb8b1f-e57b-423e-82de-5caa43e7847a-kube-api-access-frtx4\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:05.456366 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.456339 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m"] Jul 01 16:59:05.456507 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.456472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.461021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.460998 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 16:59:05.461489 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.461473 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 16:59:05.461580 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.461490 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:59:05.461649 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.461634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lzfdd\"" Jul 01 16:59:05.461877 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.461864 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:59:05.469618 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.469593 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 16:59:05.470347 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.470333 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-m6kh4"] Jul 01 16:59:05.470417 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.470407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.472685 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.472662 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m"] Jul 01 16:59:05.473154 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.473129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 16:59:05.473154 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.473134 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:59:05.473299 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.473285 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sq29d\"" Jul 01 16:59:05.473496 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.473484 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 16:59:05.473562 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.473543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 16:59:05.535281 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.535246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frtx4\" (UniqueName: \"kubernetes.io/projected/92fb8b1f-e57b-423e-82de-5caa43e7847a-kube-api-access-frtx4\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:05.535483 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.535309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4e6878a-f353-4b28-9c7e-ad8703f72694-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.535483 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.535440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x96c\" (UniqueName: \"kubernetes.io/projected/b4e6878a-f353-4b28-9c7e-ad8703f72694-kube-api-access-9x96c\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.535483 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.535463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4e6878a-f353-4b28-9c7e-ad8703f72694-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.535648 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.535504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:05.535648 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:05.535596 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:59:05.535648 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:05.535647 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls podName:92fb8b1f-e57b-423e-82de-5caa43e7847a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:06.03563181 +0000 UTC m=+51.570922215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-4q27m" (UID: "92fb8b1f-e57b-423e-82de-5caa43e7847a") : secret "samples-operator-tls" not found Jul 01 16:59:05.556611 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.556546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frtx4\" (UniqueName: \"kubernetes.io/projected/92fb8b1f-e57b-423e-82de-5caa43e7847a-kube-api-access-frtx4\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:05.636443 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-service-ca-bundle\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.636443 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-serving-cert\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.636669 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.636669 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md7tp\" (UniqueName: \"kubernetes.io/projected/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-kube-api-access-md7tp\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.636669 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/332c18f0-8843-4d02-9684-928484441559-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.636669 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:59:05.636669 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4e6878a-f353-4b28-9c7e-ad8703f72694-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.636874 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-tmp\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.636874 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-snapshots\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.636874 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:05.636715 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:05.636874 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:05.636787 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:59:21.636767848 +0000 UTC m=+67.172058260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:59:05.636874 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x96c\" (UniqueName: \"kubernetes.io/projected/b4e6878a-f353-4b28-9c7e-ad8703f72694-kube-api-access-9x96c\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.636874 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/332c18f0-8843-4d02-9684-928484441559-config\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.637185 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4e6878a-f353-4b28-9c7e-ad8703f72694-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.637185 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.636923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krqtp\" (UniqueName: \"kubernetes.io/projected/332c18f0-8843-4d02-9684-928484441559-kube-api-access-krqtp\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.637465 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.637442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4e6878a-f353-4b28-9c7e-ad8703f72694-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.638948 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.638931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4e6878a-f353-4b28-9c7e-ad8703f72694-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.648129 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.648106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x96c\" (UniqueName: \"kubernetes.io/projected/b4e6878a-f353-4b28-9c7e-ad8703f72694-kube-api-access-9x96c\") pod \"kube-storage-version-migrator-operator-79964ff6f9-jn2xc\" (UID: \"b4e6878a-f353-4b28-9c7e-ad8703f72694\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.684093 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.684058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" Jul 01 16:59:05.737459 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-tmp\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.737459 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-snapshots\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/332c18f0-8843-4d02-9684-928484441559-config\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krqtp\" (UniqueName: \"kubernetes.io/projected/332c18f0-8843-4d02-9684-928484441559-kube-api-access-krqtp\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-service-ca-bundle\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-serving-cert\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md7tp\" (UniqueName: \"kubernetes.io/projected/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-kube-api-access-md7tp\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.737707 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.737688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/332c18f0-8843-4d02-9684-928484441559-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.738158 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.738134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/332c18f0-8843-4d02-9684-928484441559-config\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.738274 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.738251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-snapshots\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.738466 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.738442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-tmp\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.738637 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.738611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-service-ca-bundle\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.738716 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.738692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.740008 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.739988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/332c18f0-8843-4d02-9684-928484441559-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.740113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.740095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-serving-cert\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.752065 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.751993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md7tp\" (UniqueName: \"kubernetes.io/projected/baf63312-fea9-4a55-a3bf-05cf6b3ae7c2-kube-api-access-md7tp\") pod \"insights-operator-5f67b55555-m6kh4\" (UID: \"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2\") " pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.752196 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.752090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krqtp\" (UniqueName: \"kubernetes.io/projected/332c18f0-8843-4d02-9684-928484441559-kube-api-access-krqtp\") pod \"service-ca-operator-5d7b7dc95c-rt58m\" (UID: \"332c18f0-8843-4d02-9684-928484441559\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.769900 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.769868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" Jul 01 16:59:05.779311 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.779281 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" Jul 01 16:59:05.831679 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.831638 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc"] Jul 01 16:59:05.835018 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:05.834949 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e6878a_f353_4b28_9c7e_ad8703f72694.slice/crio-009570c8da03ae50ecf76ec4fdaf7a4821e0b2f62df88345db3b921cd4aefb83 WatchSource:0}: Error finding container 009570c8da03ae50ecf76ec4fdaf7a4821e0b2f62df88345db3b921cd4aefb83: Status 404 returned error can't find the container with id 009570c8da03ae50ecf76ec4fdaf7a4821e0b2f62df88345db3b921cd4aefb83 Jul 01 16:59:05.968012 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.967984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-m6kh4"] Jul 01 16:59:05.979156 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:05.979127 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m"] Jul 01 16:59:05.980442 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:05.980411 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf63312_fea9_4a55_a3bf_05cf6b3ae7c2.slice/crio-37bde8c0fe1c643117dd3d3733fb2ed32779a6d3a1acdc36f44fbd7de4273c17 WatchSource:0}: Error finding container 37bde8c0fe1c643117dd3d3733fb2ed32779a6d3a1acdc36f44fbd7de4273c17: Status 404 returned error can't find the container with id 37bde8c0fe1c643117dd3d3733fb2ed32779a6d3a1acdc36f44fbd7de4273c17 Jul 01 16:59:05.982114 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:05.982004 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332c18f0_8843_4d02_9684_928484441559.slice/crio-3d4212d678ec38914a401660e7f185bf74341159d8e1ab48e6e2fd3d2eb8164e WatchSource:0}: Error finding container 3d4212d678ec38914a401660e7f185bf74341159d8e1ab48e6e2fd3d2eb8164e: Status 404 returned error can't find the container with id 3d4212d678ec38914a401660e7f185bf74341159d8e1ab48e6e2fd3d2eb8164e Jul 01 16:59:06.039852 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:06.039819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:06.040054 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:06.039983 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:59:06.040054 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:06.040049 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls podName:92fb8b1f-e57b-423e-82de-5caa43e7847a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:07.040033973 +0000 UTC m=+52.575324379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-4q27m" (UID: "92fb8b1f-e57b-423e-82de-5caa43e7847a") : secret "samples-operator-tls" not found Jul 01 16:59:06.125836 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:06.125749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" event={"ID":"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2","Type":"ContainerStarted","Data":"37bde8c0fe1c643117dd3d3733fb2ed32779a6d3a1acdc36f44fbd7de4273c17"} Jul 01 16:59:06.126869 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:06.126846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" event={"ID":"332c18f0-8843-4d02-9684-928484441559","Type":"ContainerStarted","Data":"3d4212d678ec38914a401660e7f185bf74341159d8e1ab48e6e2fd3d2eb8164e"} Jul 01 16:59:06.127828 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:06.127809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" event={"ID":"b4e6878a-f353-4b28-9c7e-ad8703f72694","Type":"ContainerStarted","Data":"009570c8da03ae50ecf76ec4fdaf7a4821e0b2f62df88345db3b921cd4aefb83"} Jul 01 16:59:07.048039 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:07.048000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:07.048511 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:07.048157 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:59:07.048511 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:07.048234 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls podName:92fb8b1f-e57b-423e-82de-5caa43e7847a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:09.04821359 +0000 UTC m=+54.583504002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-4q27m" (UID: "92fb8b1f-e57b-423e-82de-5caa43e7847a") : secret "samples-operator-tls" not found Jul 01 16:59:09.063319 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:09.063271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:09.063796 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:09.063448 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:59:09.063796 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:09.063537 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls podName:92fb8b1f-e57b-423e-82de-5caa43e7847a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:13.063513128 +0000 UTC m=+58.598803553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-4q27m" (UID: "92fb8b1f-e57b-423e-82de-5caa43e7847a") : secret "samples-operator-tls" not found Jul 01 16:59:10.140839 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:10.140791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" event={"ID":"332c18f0-8843-4d02-9684-928484441559","Type":"ContainerStarted","Data":"16b4cc7ee4c9b6a3e12022f1c5037dc2b4968df6194042d014f4228b7ae33544"} Jul 01 16:59:10.142404 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:10.142378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" event={"ID":"b4e6878a-f353-4b28-9c7e-ad8703f72694","Type":"ContainerStarted","Data":"fea8a9a2d09639ec4207397b663806d69211bb74a6dfaaf185d4886fd21d34e9"} Jul 01 16:59:10.146594 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:10.146562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" event={"ID":"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2","Type":"ContainerStarted","Data":"9cb2b298536e4da92cdef46f55d9a590256c5a42417092bc93e57008e879f60a"} Jul 01 16:59:10.161117 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:10.161023 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" podStartSLOduration=1.5942324220000001 podStartE2EDuration="5.161009399s" totalImagesPullingTime="3.566776977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:10.160306953 +0000 UTC m=+55.695597404" watchObservedRunningTime="2026-07-01 16:59:10.161009399 +0000 UTC m=+55.696299802" Jul 01 16:59:10.186513 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:10.186459 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" podStartSLOduration=1.6240484579999999 podStartE2EDuration="5.186439569s" totalImagesPullingTime="3.562391111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:10.186078824 +0000 UTC m=+55.721369273" watchObservedRunningTime="2026-07-01 16:59:10.186439569 +0000 UTC m=+55.721729987" Jul 01 16:59:10.208178 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:10.208117 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" podStartSLOduration=1.500658251 podStartE2EDuration="5.208094593s" totalImagesPullingTime="3.707436342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:10.206928136 +0000 UTC m=+55.742218586" watchObservedRunningTime="2026-07-01 16:59:10.208094593 +0000 UTC m=+55.743385021" Jul 01 16:59:11.030066 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.030033 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm"] Jul 01 16:59:11.058506 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.058475 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm"] Jul 01 16:59:11.058658 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.058620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" Jul 01 16:59:11.061851 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.061824 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ct2pn\"" Jul 01 16:59:11.061851 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.061833 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 16:59:11.062895 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.062876 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 16:59:11.080832 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.080802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvp4\" (UniqueName: \"kubernetes.io/projected/97b30a31-5d14-47fc-a0fb-5fab81bb1df2-kube-api-access-bgvp4\") pod \"migrator-786f9fbc5-jtckm\" (UID: \"97b30a31-5d14-47fc-a0fb-5fab81bb1df2\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" Jul 01 16:59:11.144108 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.144072 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvj4l"] Jul 01 16:59:11.159476 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.159440 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.167527 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.163160 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:59:11.167527 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.163216 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:59:11.167527 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.164166 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvj4l"] Jul 01 16:59:11.168229 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.167981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zdcr6\"" Jul 01 16:59:11.181508 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.181478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-data-volume\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.181687 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.181521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.181887 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.181863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvp4\" (UniqueName: \"kubernetes.io/projected/97b30a31-5d14-47fc-a0fb-5fab81bb1df2-kube-api-access-bgvp4\") pod \"migrator-786f9fbc5-jtckm\" (UID: \"97b30a31-5d14-47fc-a0fb-5fab81bb1df2\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" Jul 01 16:59:11.181982 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.181904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9clq\" (UniqueName: \"kubernetes.io/projected/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-api-access-j9clq\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.182327 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.182010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.182327 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.182090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-crio-socket\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.196898 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.196860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvp4\" (UniqueName: \"kubernetes.io/projected/97b30a31-5d14-47fc-a0fb-5fab81bb1df2-kube-api-access-bgvp4\") pod \"migrator-786f9fbc5-jtckm\" (UID: \"97b30a31-5d14-47fc-a0fb-5fab81bb1df2\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" Jul 01 16:59:11.283366 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-crio-socket\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.283366 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-data-volume\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.283366 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.283626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9clq\" (UniqueName: \"kubernetes.io/projected/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-api-access-j9clq\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.283626 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.283626 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.283513 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:11.283626 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.283546 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:11.283626 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.283604 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:11.783585376 +0000 UTC m=+57.318875795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:11.283805 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-crio-socket\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.283805 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.283628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:11.78361837 +0000 UTC m=+57.318908785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : configmap "kube-rbac-proxy" not found Jul 01 16:59:11.283805 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.283703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-data-volume\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.294075 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.294048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9clq\" (UniqueName: \"kubernetes.io/projected/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-api-access-j9clq\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.368663 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.368627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" Jul 01 16:59:11.532592 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.532562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm"] Jul 01 16:59:11.536038 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:11.536009 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b30a31_5d14_47fc_a0fb_5fab81bb1df2.slice/crio-845652001a5242c0d423411c4cbbaf4f0ee8665b21f6477e743e846c7a1ecc69 WatchSource:0}: Error finding container 845652001a5242c0d423411c4cbbaf4f0ee8665b21f6477e743e846c7a1ecc69: Status 404 returned error can't find the container with id 845652001a5242c0d423411c4cbbaf4f0ee8665b21f6477e743e846c7a1ecc69 Jul 01 16:59:11.787650 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.787556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.787804 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.787696 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:11.787804 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:11.787743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:11.787804 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.787772 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:12.787755998 +0000 UTC m=+58.323046399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : configmap "kube-rbac-proxy" not found Jul 01 16:59:11.787927 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.787832 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:11.787927 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:11.787878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:12.787866296 +0000 UTC m=+58.323156698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:12.154545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:12.154455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" event={"ID":"97b30a31-5d14-47fc-a0fb-5fab81bb1df2","Type":"ContainerStarted","Data":"845652001a5242c0d423411c4cbbaf4f0ee8665b21f6477e743e846c7a1ecc69"} Jul 01 16:59:12.795621 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:12.795592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:12.795722 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:12.795663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:12.795779 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:12.795741 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:12.795832 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:12.795802 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:14.795786119 +0000 UTC m=+60.331076521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:12.795832 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:12.795744 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:12.795938 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:12.795839 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:14.795833002 +0000 UTC m=+60.331123403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : configmap "kube-rbac-proxy" not found Jul 01 16:59:13.098508 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:13.098468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:13.098690 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:13.098591 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:59:13.098690 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:13.098646 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls podName:92fb8b1f-e57b-423e-82de-5caa43e7847a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:21.098631232 +0000 UTC m=+66.633921634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-4q27m" (UID: "92fb8b1f-e57b-423e-82de-5caa43e7847a") : secret "samples-operator-tls" not found Jul 01 16:59:13.160356 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:13.160318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" event={"ID":"97b30a31-5d14-47fc-a0fb-5fab81bb1df2","Type":"ContainerStarted","Data":"c2d27c8958e91ea93a3cf43e63cb6d467d6ae57f39e1b01749ccb5ced46b9ce8"} Jul 01 16:59:13.160730 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:13.160380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" event={"ID":"97b30a31-5d14-47fc-a0fb-5fab81bb1df2","Type":"ContainerStarted","Data":"cce750ca2ccf94105a56763801427c0413d38cafae675603a8a6fd9da0c7184a"} Jul 01 16:59:13.196519 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:13.196465 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-jtckm" podStartSLOduration=2.078030454 podStartE2EDuration="3.196450744s" totalImagesPullingTime="1.11842029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:13.195814896 +0000 UTC m=+58.731105339" watchObservedRunningTime="2026-07-01 16:59:13.196450744 +0000 UTC m=+58.731741169" Jul 01 16:59:14.224920 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:14.224892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jtdkf_ae6e244c-2600-44bd-ba30-7550176e8a53/dns-node-resolver/0.log" Jul 01 16:59:14.811347 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:14.811300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:14.811514 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:14.811379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:14.811514 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:14.811456 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:14.811514 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:14.811481 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:14.811654 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:14.811525 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:18.811507008 +0000 UTC m=+64.346797410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:14.811654 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:14.811540 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:18.811533739 +0000 UTC m=+64.346824141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : configmap "kube-rbac-proxy" not found Jul 01 16:59:14.944569 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:14.944541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsnqw_e2d1da7a-f169-4354-906a-a3d825d1c2f5/node-ca/0.log" Jul 01 16:59:15.347823 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:15.347798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6pv6w_90e7ad64-cc0f-4dff-b921-0101a0f158a7/serve-healthcheck-canary/0.log" Jul 01 16:59:15.871812 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:15.871787 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9pvd" Jul 01 16:59:15.951120 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:15.951091 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-jtckm_97b30a31-5d14-47fc-a0fb-5fab81bb1df2/migrator/0.log" Jul 01 16:59:16.145847 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:16.145747 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-jtckm_97b30a31-5d14-47fc-a0fb-5fab81bb1df2/graceful-termination/0.log" Jul 01 16:59:16.362773 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:16.362742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-jn2xc_b4e6878a-f353-4b28-9c7e-ad8703f72694/kube-storage-version-migrator-operator/0.log" Jul 01 16:59:18.844691 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:18.844658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:18.845163 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:18.844779 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:18.845163 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:18.844801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:18.845163 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:18.844856 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:26.844838909 +0000 UTC m=+72.380129314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : configmap "kube-rbac-proxy" not found Jul 01 16:59:18.845163 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:18.844929 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:18.845163 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:18.845015 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:26.845000265 +0000 UTC m=+72.380290672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:20.659247 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.659207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 16:59:20.659637 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.659259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:59:20.662777 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.662753 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:59:20.663083 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.663058 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:59:20.669711 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:20.669695 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 16:59:20.669784 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:20.669774 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs podName:12b2765d-53b9-4f4a-b4e6-88bd94cde305 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:24.669758216 +0000 UTC m=+130.205048617 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs") pod "network-metrics-daemon-mcrjd" (UID: "12b2765d-53b9-4f4a-b4e6-88bd94cde305") : secret "metrics-daemon-secret" not found Jul 01 16:59:20.672562 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.672529 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a-original-pull-secret\") pod \"global-pull-secret-syncer-26c5b\" (UID: \"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a\") " pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:59:20.759820 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.759782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:59:20.765023 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.764997 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:59:20.772947 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.772922 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:59:20.782902 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.782875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnkpp\" (UniqueName: \"kubernetes.io/projected/86bc2c27-afb4-40f9-af3c-9fe2d4a01837-kube-api-access-gnkpp\") pod \"network-check-target-wxxg6\" (UID: \"86bc2c27-afb4-40f9-af3c-9fe2d4a01837\") " pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:59:20.824594 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.824564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sw8bs\"" Jul 01 16:59:20.831487 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.831466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:59:20.916249 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.916220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26c5b" Jul 01 16:59:20.994100 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:20.994070 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxxg6"] Jul 01 16:59:20.998640 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:20.998615 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bc2c27_afb4_40f9_af3c_9fe2d4a01837.slice/crio-352c3ff9f5f6a4a367c031de27e1868e974c3fc71fd92154eba83362acaf18a0 WatchSource:0}: Error finding container 352c3ff9f5f6a4a367c031de27e1868e974c3fc71fd92154eba83362acaf18a0: Status 404 returned error can't find the container with id 352c3ff9f5f6a4a367c031de27e1868e974c3fc71fd92154eba83362acaf18a0 Jul 01 16:59:21.076099 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.076073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-26c5b"] Jul 01 16:59:21.078511 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:21.078486 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4060cbc2_f1bf_4fa0_b86b_feb2f9d2809a.slice/crio-3eef5a9e141aa146b68ef2cf5315dbe5b766e25111e4390d119ec7406390eeb8 WatchSource:0}: Error finding container 3eef5a9e141aa146b68ef2cf5315dbe5b766e25111e4390d119ec7406390eeb8: Status 404 returned error can't find the container with id 3eef5a9e141aa146b68ef2cf5315dbe5b766e25111e4390d119ec7406390eeb8 Jul 01 16:59:21.162803 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.162716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:21.165200 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.165172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/92fb8b1f-e57b-423e-82de-5caa43e7847a-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-4q27m\" (UID: \"92fb8b1f-e57b-423e-82de-5caa43e7847a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:21.186593 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.186563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxxg6" event={"ID":"86bc2c27-afb4-40f9-af3c-9fe2d4a01837","Type":"ContainerStarted","Data":"352c3ff9f5f6a4a367c031de27e1868e974c3fc71fd92154eba83362acaf18a0"} Jul 01 16:59:21.187586 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.187558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-26c5b" event={"ID":"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a","Type":"ContainerStarted","Data":"3eef5a9e141aa146b68ef2cf5315dbe5b766e25111e4390d119ec7406390eeb8"} Jul 01 16:59:21.233717 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.233684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dzb9s\"" Jul 01 16:59:21.241216 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.241189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" Jul 01 16:59:21.395864 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.395831 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m"] Jul 01 16:59:21.668629 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:21.668550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:59:21.669060 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:21.668684 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:21.669060 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:21.668756 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls podName:ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa nodeName:}" failed. No retries permitted until 2026-07-01 16:59:53.668736522 +0000 UTC m=+99.204026928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls") pod "dns-default-6gl52" (UID: "ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa") : secret "dns-default-metrics-tls" not found Jul 01 16:59:22.195561 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:22.195484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" event={"ID":"92fb8b1f-e57b-423e-82de-5caa43e7847a","Type":"ContainerStarted","Data":"a87c27e31c3471a9cf4c1f08899b29143386794006f1e4b28791908b99c5b4c5"} Jul 01 16:59:26.915497 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:26.915469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:26.915900 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:26.915529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:26.915900 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:26.915633 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:26.915900 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:26.915682 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls podName:f7ea4666-cbf9-4613-aa0b-0014d666bf8d nodeName:}" failed. No retries permitted until 2026-07-01 16:59:42.915668313 +0000 UTC m=+88.450958716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zvj4l" (UID: "f7ea4666-cbf9-4613-aa0b-0014d666bf8d") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:26.916044 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:26.915926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:27.215301 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.215259 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" event={"ID":"92fb8b1f-e57b-423e-82de-5caa43e7847a","Type":"ContainerStarted","Data":"a50d2a58b5f9c7bcc0091fa8b0ae8bb98106e2a853a23eb4e19883d987fc2e29"} Jul 01 16:59:27.215470 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.215328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" event={"ID":"92fb8b1f-e57b-423e-82de-5caa43e7847a","Type":"ContainerStarted","Data":"94989f2150655a4bb23520cd06ea811f9a1d7858961bedb56d66f7133208bc0a"} Jul 01 16:59:27.216733 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.216705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxxg6" event={"ID":"86bc2c27-afb4-40f9-af3c-9fe2d4a01837","Type":"ContainerStarted","Data":"d91abe4f348bf57934aafbd56f3f5b112b92cfe0bbe85ec3613c8eceea305850"} Jul 01 16:59:27.216844 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.216775 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:59:27.218161 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.218142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-26c5b" event={"ID":"4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a","Type":"ContainerStarted","Data":"cda6e6f5fee342810b1d5940bf76196d930a65755482f6a701fc3083cd4e47e7"} Jul 01 16:59:27.243110 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.243060 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-4q27m" podStartSLOduration=17.499445693 podStartE2EDuration="22.243043451s" totalImagesPullingTime="4.743597758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:27.241934284 +0000 UTC m=+72.777224718" watchObservedRunningTime="2026-07-01 16:59:27.243043451 +0000 UTC m=+72.778333874" Jul 01 16:59:27.259604 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.259554 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-26c5b" podStartSLOduration=67.140332081 podStartE2EDuration="1m12.259537462s" totalImagesPullingTime="5.119205381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:27.258952422 +0000 UTC m=+72.794242846" watchObservedRunningTime="2026-07-01 16:59:27.259537462 +0000 UTC m=+72.794827883" Jul 01 16:59:27.287281 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:27.287236 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wxxg6" podStartSLOduration=67.099449095 podStartE2EDuration="1m12.287221443s" totalImagesPullingTime="5.187772348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:27.286274422 +0000 UTC m=+72.821564868" watchObservedRunningTime="2026-07-01 16:59:27.287221443 +0000 UTC m=+72.822511893" Jul 01 16:59:40.359762 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.359650 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs"] Jul 01 16:59:40.362896 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.362876 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9c7dfd487-hzxmx"] Jul 01 16:59:40.363021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.363001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.364768 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.364751 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.368800 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.368773 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:59:40.368908 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.368857 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 16:59:40.368908 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.368787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mkqln\"" Jul 01 16:59:40.369053 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.368938 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:59:40.369107 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.369073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g89wz\"" Jul 01 16:59:40.369511 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.369487 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 16:59:40.370428 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.370406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:59:40.377037 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.377013 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:59:40.381876 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.381857 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs"] Jul 01 16:59:40.387565 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.387540 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9c7dfd487-hzxmx"] Jul 01 16:59:40.449044 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.449012 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c7dfd487-hzxmx"] Jul 01 16:59:40.449227 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:40.449205 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-zxpb8 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-zxpb8 registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" podUID="0de29e44-a23e-42db-aa53-f3e02db992d6" Jul 01 16:59:40.513972 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.513929 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d4c5d7d76-f6q4h"] Jul 01 16:59:40.515922 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.515902 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.525896 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.525875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-certificates\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526024 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.525908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-tls\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526024 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.525937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-bound-sa-token\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526024 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.525994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/59b93481-8962-4420-8bd5-0d7ada24e8e8-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-gpwhs\" (UID: \"59b93481-8962-4420-8bd5-0d7ada24e8e8\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.526024 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.526019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0de29e44-a23e-42db-aa53-f3e02db992d6-ca-trust-extracted\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526159 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.526042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-installation-pull-secrets\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526159 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.526115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-trusted-ca\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526159 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.526147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59b93481-8962-4420-8bd5-0d7ada24e8e8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-gpwhs\" (UID: \"59b93481-8962-4420-8bd5-0d7ada24e8e8\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.526249 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.526169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-image-registry-private-configuration\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.526249 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.526185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxpb8\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-kube-api-access-zxpb8\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.550704 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.550677 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4c5d7d76-f6q4h"] Jul 01 16:59:40.627296 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-registry-tls\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627296 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-trusted-ca\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627296 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59b93481-8962-4420-8bd5-0d7ada24e8e8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-gpwhs\" (UID: \"59b93481-8962-4420-8bd5-0d7ada24e8e8\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-image-registry-private-configuration\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxpb8\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-kube-api-access-zxpb8\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-installation-pull-secrets\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-certificates\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-trusted-ca\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmcm\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-kube-api-access-knmcm\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627545 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-tls\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-bound-sa-token\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-bound-sa-token\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/59b93481-8962-4420-8bd5-0d7ada24e8e8-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-gpwhs\" (UID: \"59b93481-8962-4420-8bd5-0d7ada24e8e8\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0de29e44-a23e-42db-aa53-f3e02db992d6-ca-trust-extracted\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-installation-pull-secrets\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-registry-certificates\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-ca-trust-extracted\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.627858 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.627807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-image-registry-private-configuration\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.628275 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.628213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0de29e44-a23e-42db-aa53-f3e02db992d6-ca-trust-extracted\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.628341 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.628315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-certificates\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.628399 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.628353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-trusted-ca\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.628861 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.628833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/59b93481-8962-4420-8bd5-0d7ada24e8e8-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-gpwhs\" (UID: \"59b93481-8962-4420-8bd5-0d7ada24e8e8\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.629922 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.629900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-image-registry-private-configuration\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.630039 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.629931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59b93481-8962-4420-8bd5-0d7ada24e8e8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-gpwhs\" (UID: \"59b93481-8962-4420-8bd5-0d7ada24e8e8\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.630197 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.630180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-tls\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.630268 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.630251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-installation-pull-secrets\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.643072 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.643049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-bound-sa-token\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.643303 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.643283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxpb8\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-kube-api-access-zxpb8\") pod \"image-registry-9c7dfd487-hzxmx\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:40.674193 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.674156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" Jul 01 16:59:40.728768 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.728741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-registry-certificates\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.728931 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.728775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-ca-trust-extracted\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.728931 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.728805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-image-registry-private-configuration\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729085 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.728943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-registry-tls\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729085 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.729071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-installation-pull-secrets\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.729100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-trusted-ca\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.729116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knmcm\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-kube-api-access-knmcm\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729207 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.729148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-bound-sa-token\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729362 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.729248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-ca-trust-extracted\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.729967 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.729924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-registry-certificates\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.730642 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.730613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-trusted-ca\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.731453 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.731426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-image-registry-private-configuration\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.732223 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.732199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-registry-tls\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.732335 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.732240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-installation-pull-secrets\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.741137 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.741110 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-bound-sa-token\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.741523 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.741501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmcm\" (UniqueName: \"kubernetes.io/projected/2f38967f-a74f-4987-8ed1-fdb25fa05b6f-kube-api-access-knmcm\") pod \"image-registry-d4c5d7d76-f6q4h\" (UID: \"2f38967f-a74f-4987-8ed1-fdb25fa05b6f\") " pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.808682 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.808483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs"] Jul 01 16:59:40.811251 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:40.811220 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b93481_8962_4420_8bd5_0d7ada24e8e8.slice/crio-01524c9d336bb665c847b275173f9613d61354f053a2246cad01b380f48cc445 WatchSource:0}: Error finding container 01524c9d336bb665c847b275173f9613d61354f053a2246cad01b380f48cc445: Status 404 returned error can't find the container with id 01524c9d336bb665c847b275173f9613d61354f053a2246cad01b380f48cc445 Jul 01 16:59:40.824912 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.824890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:40.957903 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:40.957875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4c5d7d76-f6q4h"] Jul 01 16:59:40.959933 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:40.959908 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f38967f_a74f_4987_8ed1_fdb25fa05b6f.slice/crio-f896cb5ed78cd91062027df3783fdd3e972447b0fa1a01ceb2c0a20786cfbc23 WatchSource:0}: Error finding container f896cb5ed78cd91062027df3783fdd3e972447b0fa1a01ceb2c0a20786cfbc23: Status 404 returned error can't find the container with id f896cb5ed78cd91062027df3783fdd3e972447b0fa1a01ceb2c0a20786cfbc23 Jul 01 16:59:41.267826 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.267794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" event={"ID":"59b93481-8962-4420-8bd5-0d7ada24e8e8","Type":"ContainerStarted","Data":"01524c9d336bb665c847b275173f9613d61354f053a2246cad01b380f48cc445"} Jul 01 16:59:41.269284 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.269256 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" event={"ID":"2f38967f-a74f-4987-8ed1-fdb25fa05b6f","Type":"ContainerStarted","Data":"b1b1ce9c8544504a8ae364b4cda1720d43552bd79375ad97b141a03effafc0f1"} Jul 01 16:59:41.269422 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.269309 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" event={"ID":"2f38967f-a74f-4987-8ed1-fdb25fa05b6f","Type":"ContainerStarted","Data":"f896cb5ed78cd91062027df3783fdd3e972447b0fa1a01ceb2c0a20786cfbc23"} Jul 01 16:59:41.269422 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.269266 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:41.269422 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.269357 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 16:59:41.274919 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.274895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:41.300239 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.300192 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" podStartSLOduration=1.3001758749999999 podStartE2EDuration="1.300175875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:41.299851809 +0000 UTC m=+86.835142236" watchObservedRunningTime="2026-07-01 16:59:41.300175875 +0000 UTC m=+86.835466299" Jul 01 16:59:41.436443 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-tls\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.436443 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0de29e44-a23e-42db-aa53-f3e02db992d6-ca-trust-extracted\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436479 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-image-registry-private-configuration\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436545 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-trusted-ca\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436572 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-bound-sa-token\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436621 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-certificates\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436679 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-installation-pull-secrets\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436704 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxpb8\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-kube-api-access-zxpb8\") pod \"0de29e44-a23e-42db-aa53-f3e02db992d6\" (UID: \"0de29e44-a23e-42db-aa53-f3e02db992d6\") " Jul 01 16:59:41.437013 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.436747 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0de29e44-a23e-42db-aa53-f3e02db992d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:59:41.437382 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.437066 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0de29e44-a23e-42db-aa53-f3e02db992d6-ca-trust-extracted\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.437382 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.437095 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:59:41.437562 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.437456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:59:41.439009 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.438975 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:59:41.439156 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.439128 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:59:41.439224 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.439152 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-kube-api-access-zxpb8" (OuterVolumeSpecName: "kube-api-access-zxpb8") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "kube-api-access-zxpb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:59:41.439224 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.439164 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:59:41.439517 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.439492 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0de29e44-a23e-42db-aa53-f3e02db992d6" (UID: "0de29e44-a23e-42db-aa53-f3e02db992d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538462 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-trusted-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538489 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-bound-sa-token\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538498 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-certificates\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538510 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-installation-pull-secrets\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538524 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxpb8\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-kube-api-access-zxpb8\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538538 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0de29e44-a23e-42db-aa53-f3e02db992d6-registry-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:41.538540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:41.538548 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0de29e44-a23e-42db-aa53-f3e02db992d6-image-registry-private-configuration\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 16:59:42.274435 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.274397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c7dfd487-hzxmx" Jul 01 16:59:42.328036 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.328003 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c7dfd487-hzxmx"] Jul 01 16:59:42.343917 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.343892 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9c7dfd487-hzxmx"] Jul 01 16:59:42.907572 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.907491 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0de29e44-a23e-42db-aa53-f3e02db992d6" path="/var/lib/kubelet/pods/0de29e44-a23e-42db-aa53-f3e02db992d6/volumes" Jul 01 16:59:42.948006 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.947972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:42.950251 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.950231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7ea4666-cbf9-4613-aa0b-0014d666bf8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvj4l\" (UID: \"f7ea4666-cbf9-4613-aa0b-0014d666bf8d\") " pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:42.977859 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.977827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zdcr6\"" Jul 01 16:59:42.984770 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:42.984746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvj4l" Jul 01 16:59:43.143834 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.143801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvj4l"] Jul 01 16:59:43.146732 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:43.146704 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ea4666_cbf9_4613_aa0b_0014d666bf8d.slice/crio-49fe93be54848f11c056055e11184540c9b47249ad210abe45e92843d7a95972 WatchSource:0}: Error finding container 49fe93be54848f11c056055e11184540c9b47249ad210abe45e92843d7a95972: Status 404 returned error can't find the container with id 49fe93be54848f11c056055e11184540c9b47249ad210abe45e92843d7a95972 Jul 01 16:59:43.278698 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.278664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" event={"ID":"59b93481-8962-4420-8bd5-0d7ada24e8e8","Type":"ContainerStarted","Data":"7925ebc58981696d247bfbf77cb02097b2d694a84fdace3db5303e458953d9ed"} Jul 01 16:59:43.279926 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.279899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvj4l" event={"ID":"f7ea4666-cbf9-4613-aa0b-0014d666bf8d","Type":"ContainerStarted","Data":"49fe93be54848f11c056055e11184540c9b47249ad210abe45e92843d7a95972"} Jul 01 16:59:43.311204 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.311158 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-gpwhs" podStartSLOduration=1.678380503 podStartE2EDuration="3.311142514s" totalImagesPullingTime="1.632762011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:43.307359178 +0000 UTC m=+88.842649602" watchObservedRunningTime="2026-07-01 16:59:43.311142514 +0000 UTC m=+88.846432937" Jul 01 16:59:43.482997 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.482947 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f"] Jul 01 16:59:43.511441 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.511412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:43.518238 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.518210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 16:59:43.518511 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.518494 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9mgtt\"" Jul 01 16:59:43.522715 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.522689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f"] Jul 01 16:59:43.653458 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.653369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a98a131-321b-4bdb-a33d-3528d91bbf0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-2wl2f\" (UID: \"8a98a131-321b-4bdb-a33d-3528d91bbf0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:43.754738 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:43.754686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a98a131-321b-4bdb-a33d-3528d91bbf0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-2wl2f\" (UID: \"8a98a131-321b-4bdb-a33d-3528d91bbf0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:43.754929 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:43.754838 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 16:59:43.754992 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:43.754930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a98a131-321b-4bdb-a33d-3528d91bbf0b-tls-certificates podName:8a98a131-321b-4bdb-a33d-3528d91bbf0b nodeName:}" failed. No retries permitted until 2026-07-01 16:59:44.254912192 +0000 UTC m=+89.790202595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8a98a131-321b-4bdb-a33d-3528d91bbf0b-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" (UID: "8a98a131-321b-4bdb-a33d-3528d91bbf0b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 16:59:44.260017 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:44.259974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a98a131-321b-4bdb-a33d-3528d91bbf0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-2wl2f\" (UID: \"8a98a131-321b-4bdb-a33d-3528d91bbf0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:44.263507 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:44.263454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a98a131-321b-4bdb-a33d-3528d91bbf0b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-2wl2f\" (UID: \"8a98a131-321b-4bdb-a33d-3528d91bbf0b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:44.421044 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:44.421006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:44.598565 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:44.598519 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f"] Jul 01 16:59:44.602567 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:44.602540 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a98a131_321b_4bdb_a33d_3528d91bbf0b.slice/crio-d672b0575f3317625a7ceec7e41f2ebaabcdcbf825676ec2e71e361509c343d9 WatchSource:0}: Error finding container d672b0575f3317625a7ceec7e41f2ebaabcdcbf825676ec2e71e361509c343d9: Status 404 returned error can't find the container with id d672b0575f3317625a7ceec7e41f2ebaabcdcbf825676ec2e71e361509c343d9 Jul 01 16:59:45.289082 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:45.289039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" event={"ID":"8a98a131-321b-4bdb-a33d-3528d91bbf0b","Type":"ContainerStarted","Data":"d672b0575f3317625a7ceec7e41f2ebaabcdcbf825676ec2e71e361509c343d9"} Jul 01 16:59:48.300982 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:48.300928 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" event={"ID":"8a98a131-321b-4bdb-a33d-3528d91bbf0b","Type":"ContainerStarted","Data":"b423c5ae1ca054bf5c21033ff1ec5bb0fb2713b98e0d4b3b6840e6f2193280ba"} Jul 01 16:59:48.301478 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:48.301109 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:48.302825 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:48.302792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvj4l" event={"ID":"f7ea4666-cbf9-4613-aa0b-0014d666bf8d","Type":"ContainerStarted","Data":"4e968cf1677fb3fd6a8c600846a4b26a3b2f084335819a66206e9c4e8f311550"} Jul 01 16:59:48.302944 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:48.302848 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvj4l" event={"ID":"f7ea4666-cbf9-4613-aa0b-0014d666bf8d","Type":"ContainerStarted","Data":"19fcb7c2f1e19fec335a8b44a6ffc7890c2422db16641e1ed3f1855f9377182a"} Jul 01 16:59:48.306135 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:48.306117 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" Jul 01 16:59:48.327200 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:48.327140 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-2wl2f" podStartSLOduration=2.487332904 podStartE2EDuration="5.327125195s" totalImagesPullingTime="2.839792291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:48.326811094 +0000 UTC m=+93.862101518" watchObservedRunningTime="2026-07-01 16:59:48.327125195 +0000 UTC m=+93.862415629" Jul 01 16:59:52.318725 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:52.318686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvj4l" event={"ID":"f7ea4666-cbf9-4613-aa0b-0014d666bf8d","Type":"ContainerStarted","Data":"a9c6c529fbecc234e6b5aede70fdfa83e6014f4553976e77c92e9403f152720a"} Jul 01 16:59:52.358376 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:52.358327 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvj4l" podStartSLOduration=33.098497353 podStartE2EDuration="41.358312648s" totalImagesPullingTime="8.259815295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:59:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:52.357489167 +0000 UTC m=+97.892779610" watchObservedRunningTime="2026-07-01 16:59:52.358312648 +0000 UTC m=+97.893603071" Jul 01 16:59:53.737728 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:53.737696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:59:53.740136 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:53.740112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa-metrics-tls\") pod \"dns-default-6gl52\" (UID: \"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa\") " pod="openshift-dns/dns-default-6gl52" Jul 01 16:59:53.743348 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:53.743330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shlnm\"" Jul 01 16:59:53.751237 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:53.751218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gl52" Jul 01 16:59:53.896909 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:53.896877 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gl52"] Jul 01 16:59:53.901246 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:53.901215 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2d2356_f8a8_4880_a96b_d63fbfbcf0fa.slice/crio-d7cb02d0e405a004a08708ba27cee343c9cbd5bb6c718c1d6bd434d21a8b559e WatchSource:0}: Error finding container d7cb02d0e405a004a08708ba27cee343c9cbd5bb6c718c1d6bd434d21a8b559e: Status 404 returned error can't find the container with id d7cb02d0e405a004a08708ba27cee343c9cbd5bb6c718c1d6bd434d21a8b559e Jul 01 16:59:54.255813 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.255781 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86"] Jul 01 16:59:54.269461 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.269437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.281326 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.281297 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:59:54.281326 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.281315 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:59:54.281502 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.281297 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 16:59:54.281502 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.281322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:59:54.287666 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.287640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6d2r7\"" Jul 01 16:59:54.288520 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.288499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86"] Jul 01 16:59:54.300577 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.300555 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 16:59:54.303348 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.303328 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-585rl"] Jul 01 16:59:54.311088 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.311069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.320365 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.320346 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 16:59:54.320461 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.320381 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 16:59:54.320869 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.320855 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q8hr7\"" Jul 01 16:59:54.326567 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.326542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gl52" event={"ID":"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa","Type":"ContainerStarted","Data":"d7cb02d0e405a004a08708ba27cee343c9cbd5bb6c718c1d6bd434d21a8b559e"} Jul 01 16:59:54.357775 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.357603 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 16:59:54.358719 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.358696 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bw99k"] Jul 01 16:59:54.367701 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.367673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.375024 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.374907 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-585rl"] Jul 01 16:59:54.379174 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.378883 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:59:54.379174 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.379027 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:59:54.379174 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.379171 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ttjh4\"" Jul 01 16:59:54.379384 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.379198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:59:54.445689 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.445689 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0807c53d-f094-40bb-b29d-525d5e4470e8-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.445689 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r222\" (UniqueName: \"kubernetes.io/projected/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-kube-api-access-9r222\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.446021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.446021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.446021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.446021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0807c53d-f094-40bb-b29d-525d5e4470e8-metrics-client-ca\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.446021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.445951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqf9\" (UniqueName: \"kubernetes.io/projected/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-api-access-pnqf9\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.446021 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.446010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.446275 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.446082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.547069 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.546989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.547069 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0807c53d-f094-40bb-b29d-525d5e4470e8-metrics-client-ca\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.547069 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqf9\" (UniqueName: \"kubernetes.io/projected/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-api-access-pnqf9\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.547385 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-textfile\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547385 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.547489 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547489 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47d241e6-d773-41ae-8157-69c5837339d7-metrics-client-ca\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547489 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.547632 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547632 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2drh\" (UniqueName: \"kubernetes.io/projected/47d241e6-d773-41ae-8157-69c5837339d7-kube-api-access-w2drh\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547632 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-wtmp\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547632 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0807c53d-f094-40bb-b29d-525d5e4470e8-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r222\" (UniqueName: \"kubernetes.io/projected/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-kube-api-access-9r222\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-root\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-tls\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.547827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-sys\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.548216 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.547840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0807c53d-f094-40bb-b29d-525d5e4470e8-metrics-client-ca\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.548286 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.548204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0807c53d-f094-40bb-b29d-525d5e4470e8-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.548568 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.548525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.548650 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.548581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.550271 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.550247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.550498 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.550476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.550603 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.550579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.550936 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.550913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.561588 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.561563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqf9\" (UniqueName: \"kubernetes.io/projected/0807c53d-f094-40bb-b29d-525d5e4470e8-kube-api-access-pnqf9\") pod \"kube-state-metrics-845b954455-585rl\" (UID: \"0807c53d-f094-40bb-b29d-525d5e4470e8\") " pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.562395 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.562373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r222\" (UniqueName: \"kubernetes.io/projected/aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c-kube-api-access-9r222\") pod \"openshift-state-metrics-57f99c8b49-zrv86\" (UID: \"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.579210 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.579183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" Jul 01 16:59:54.619815 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.619780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" Jul 01 16:59:54.649251 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47d241e6-d773-41ae-8157-69c5837339d7-metrics-client-ca\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649414 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649414 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2drh\" (UniqueName: \"kubernetes.io/projected/47d241e6-d773-41ae-8157-69c5837339d7-kube-api-access-w2drh\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649414 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-wtmp\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649414 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-root\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649656 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-tls\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649656 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-sys\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649656 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-textfile\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.649656 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.649530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.651605 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.650784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-root\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.651605 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.651094 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47d241e6-d773-41ae-8157-69c5837339d7-metrics-client-ca\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.651605 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:54.651210 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 16:59:54.651605 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:54.651281 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-tls podName:47d241e6-d773-41ae-8157-69c5837339d7 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:55.151262681 +0000 UTC m=+100.686553097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-tls") pod "node-exporter-bw99k" (UID: "47d241e6-d773-41ae-8157-69c5837339d7") : secret "node-exporter-tls" not found Jul 01 16:59:54.651605 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.651304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-sys\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.651605 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.651434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-wtmp\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.651939 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.651690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-textfile\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.653163 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.653135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.653651 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.653624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.669788 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.669734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2drh\" (UniqueName: \"kubernetes.io/projected/47d241e6-d773-41ae-8157-69c5837339d7-kube-api-access-w2drh\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:54.777511 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.777478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86"] Jul 01 16:59:54.784638 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:54.784605 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa11dcef_7bdd_4b4e_a0f5_ba9cc286be4c.slice/crio-f9aabc014575174ce7ff4bc0a834e7aa7d071ce12c848c521c1872bd858f58ad WatchSource:0}: Error finding container f9aabc014575174ce7ff4bc0a834e7aa7d071ce12c848c521c1872bd858f58ad: Status 404 returned error can't find the container with id f9aabc014575174ce7ff4bc0a834e7aa7d071ce12c848c521c1872bd858f58ad Jul 01 16:59:54.836234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:54.836203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-585rl"] Jul 01 16:59:54.840051 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:54.840021 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0807c53d_f094_40bb_b29d_525d5e4470e8.slice/crio-46561b888f55581b9e225cde8795582fdcc71bd6d01a1b6ba3fe789d33e56f2e WatchSource:0}: Error finding container 46561b888f55581b9e225cde8795582fdcc71bd6d01a1b6ba3fe789d33e56f2e: Status 404 returned error can't find the container with id 46561b888f55581b9e225cde8795582fdcc71bd6d01a1b6ba3fe789d33e56f2e Jul 01 16:59:55.154397 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.154306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-tls\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:55.156930 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.156900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47d241e6-d773-41ae-8157-69c5837339d7-node-exporter-tls\") pod \"node-exporter-bw99k\" (UID: \"47d241e6-d773-41ae-8157-69c5837339d7\") " pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:55.279347 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.279310 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bw99k" Jul 01 16:59:55.332704 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.332665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" event={"ID":"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c","Type":"ContainerStarted","Data":"4852e2c41b94dae57ed6894908e14cf6a4b4c2a12f27344bb675aa53788599c2"} Jul 01 16:59:55.332881 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.332763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" event={"ID":"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c","Type":"ContainerStarted","Data":"08e0c582ba8f7e029a7430a8232bd61a9d0cd1e98c244c4263262332f22ffb40"} Jul 01 16:59:55.332881 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.332791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" event={"ID":"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c","Type":"ContainerStarted","Data":"f9aabc014575174ce7ff4bc0a834e7aa7d071ce12c848c521c1872bd858f58ad"} Jul 01 16:59:55.333948 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.333919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" event={"ID":"0807c53d-f094-40bb-b29d-525d5e4470e8","Type":"ContainerStarted","Data":"46561b888f55581b9e225cde8795582fdcc71bd6d01a1b6ba3fe789d33e56f2e"} Jul 01 16:59:55.370868 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.370831 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:59:55.388792 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.388758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.393923 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.393901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 16:59:55.400838 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.400816 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 16:59:55.400987 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.400816 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 16:59:55.406930 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.406821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 16:59:55.406930 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.406871 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 16:59:55.406930 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.406883 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rf7md\"" Jul 01 16:59:55.406930 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.406917 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 16:59:55.407203 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.406871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 16:59:55.407258 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.407245 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 16:59:55.407360 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.407245 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 16:59:55.417540 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.417511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:59:55.456280 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456454 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xd8f\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-kube-api-access-9xd8f\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-volume\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-out\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456634 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-web-config\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456852 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.456852 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.456692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.557921 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.557887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.557921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.557985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xd8f\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-kube-api-access-9xd8f\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-volume\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558113 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-out\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-web-config\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558410 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558688 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.558688 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:55.558667 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 01 16:59:55.558812 ip-10-0-140-96 kubenswrapper[2577]: E0701 16:59:55.558788 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls podName:e90b0301-fb35-4ef2-8f0d-f7632ea16d56 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:56.058766552 +0000 UTC m=+101.594056969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56") : secret "alertmanager-main-tls" not found Jul 01 16:59:55.558885 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.558845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.559937 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.559915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.561662 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.561604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.561662 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.561609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.561856 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.561765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-web-config\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.562187 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.562163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.562354 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.562334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.563006 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.562985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.563268 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.563249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-volume\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.563467 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.563452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-out\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.639429 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:55.639393 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xd8f\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-kube-api-access-9xd8f\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:55.782986 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:55.782940 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d241e6_d773_41ae_8157_69c5837339d7.slice/crio-b0fff27b44dc6df24501960729d2fabfb7c5e3a2d3dd453139a9f3b1a6772a06 WatchSource:0}: Error finding container b0fff27b44dc6df24501960729d2fabfb7c5e3a2d3dd453139a9f3b1a6772a06: Status 404 returned error can't find the container with id b0fff27b44dc6df24501960729d2fabfb7c5e3a2d3dd453139a9f3b1a6772a06 Jul 01 16:59:56.062909 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:56.062824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:56.065234 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:56.065215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:56.299972 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:56.299798 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:59:56.346209 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:56.346025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bw99k" event={"ID":"47d241e6-d773-41ae-8157-69c5837339d7","Type":"ContainerStarted","Data":"b0fff27b44dc6df24501960729d2fabfb7c5e3a2d3dd453139a9f3b1a6772a06"} Jul 01 16:59:56.350678 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:56.350588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gl52" event={"ID":"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa","Type":"ContainerStarted","Data":"96fe4a8b64d15a2dede33b09066645d20b14246e9640e7dbcbfbe2fd5120f018"} Jul 01 16:59:56.529040 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:56.529008 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:59:56.798851 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:56.798803 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90b0301_fb35_4ef2_8f0d_f7632ea16d56.slice/crio-bd0ddcac0d273a04f4564d69910d8cb5d18b82ce8c48f78a89cc00595e7e1f58 WatchSource:0}: Error finding container bd0ddcac0d273a04f4564d69910d8cb5d18b82ce8c48f78a89cc00595e7e1f58: Status 404 returned error can't find the container with id bd0ddcac0d273a04f4564d69910d8cb5d18b82ce8c48f78a89cc00595e7e1f58 Jul 01 16:59:57.360060 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:57.359988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"bd0ddcac0d273a04f4564d69910d8cb5d18b82ce8c48f78a89cc00595e7e1f58"} Jul 01 16:59:57.361820 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:57.361784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gl52" event={"ID":"ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa","Type":"ContainerStarted","Data":"d21661cd0bf50cb3a0744e94cff8e109efea45831b2901f567658e270357b26d"} Jul 01 16:59:57.361981 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:57.361943 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6gl52" Jul 01 16:59:57.396595 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:57.396532 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6gl52" podStartSLOduration=66.156220419 podStartE2EDuration="1m8.396510752s" totalImagesPullingTime="2.240290333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:57.395418183 +0000 UTC m=+102.930708608" watchObservedRunningTime="2026-07-01 16:59:57.396510752 +0000 UTC m=+102.931801176" Jul 01 16:59:58.224184 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.224148 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wxxg6" Jul 01 16:59:58.372606 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.372527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" event={"ID":"aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c","Type":"ContainerStarted","Data":"34735e05c66418ce98ba42d0ad7171f659c4355c6e24704015bfc8a48f5a5b7e"} Jul 01 16:59:58.375537 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.375508 2577 generic.go:356] "Generic (PLEG): container finished" podID="47d241e6-d773-41ae-8157-69c5837339d7" containerID="013efb6041b32b134f82205411d5dc9a59a67a6beccf64e439f3bd943c048c01" exitCode=0 Jul 01 16:59:58.375912 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.375884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bw99k" event={"ID":"47d241e6-d773-41ae-8157-69c5837339d7","Type":"ContainerDied","Data":"013efb6041b32b134f82205411d5dc9a59a67a6beccf64e439f3bd943c048c01"} Jul 01 16:59:58.379122 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.379043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" event={"ID":"0807c53d-f094-40bb-b29d-525d5e4470e8","Type":"ContainerStarted","Data":"6e332434323932605a70fe7e8856439f48379a97dce2de6acc73314ff63c5332"} Jul 01 16:59:58.379122 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.379110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" event={"ID":"0807c53d-f094-40bb-b29d-525d5e4470e8","Type":"ContainerStarted","Data":"0713b9456f9df9febd4b6c7a31070388e160a04579e7ff586bd9f3b2d69956f3"} Jul 01 16:59:58.379293 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.379143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" event={"ID":"0807c53d-f094-40bb-b29d-525d5e4470e8","Type":"ContainerStarted","Data":"e993594feaf749f643e9924cc4fa779f1cfa2e360c94831df21d23eead5b6b5e"} Jul 01 16:59:58.427360 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.427303 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zrv86" podStartSLOduration=1.393336822 podStartE2EDuration="4.427284094s" totalImagesPullingTime="3.033947272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:58.426576802 +0000 UTC m=+103.961867226" watchObservedRunningTime="2026-07-01 16:59:58.427284094 +0000 UTC m=+103.962574518" Jul 01 16:59:58.884802 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.884742 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-585rl" podStartSLOduration=1.737885907 podStartE2EDuration="4.8847242s" totalImagesPullingTime="3.146838293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:58.530757305 +0000 UTC m=+104.066047730" watchObservedRunningTime="2026-07-01 16:59:58.8847242 +0000 UTC m=+104.420014623" Jul 01 16:59:58.885462 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.885435 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7"] Jul 01 16:59:58.887642 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.887624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:58.897688 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.897660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-28sdk\"" Jul 01 16:59:58.897796 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.897765 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 16:59:58.927444 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.927409 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7"] Jul 01 16:59:58.991509 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.991473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e08b0d6-db97-405d-b95b-dad1b909afa2-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wgzd7\" (UID: \"8e08b0d6-db97-405d-b95b-dad1b909afa2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:58.991678 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:58.991522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtwln\" (UniqueName: \"kubernetes.io/projected/8e08b0d6-db97-405d-b95b-dad1b909afa2-kube-api-access-wtwln\") pod \"monitoring-plugin-cd8656b8-wgzd7\" (UID: \"8e08b0d6-db97-405d-b95b-dad1b909afa2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:59.092128 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.092088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtwln\" (UniqueName: \"kubernetes.io/projected/8e08b0d6-db97-405d-b95b-dad1b909afa2-kube-api-access-wtwln\") pod \"monitoring-plugin-cd8656b8-wgzd7\" (UID: \"8e08b0d6-db97-405d-b95b-dad1b909afa2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:59.092302 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.092195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e08b0d6-db97-405d-b95b-dad1b909afa2-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wgzd7\" (UID: \"8e08b0d6-db97-405d-b95b-dad1b909afa2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:59.094533 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.094511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e08b0d6-db97-405d-b95b-dad1b909afa2-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wgzd7\" (UID: \"8e08b0d6-db97-405d-b95b-dad1b909afa2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:59.107518 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.107498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtwln\" (UniqueName: \"kubernetes.io/projected/8e08b0d6-db97-405d-b95b-dad1b909afa2-kube-api-access-wtwln\") pod \"monitoring-plugin-cd8656b8-wgzd7\" (UID: \"8e08b0d6-db97-405d-b95b-dad1b909afa2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:59.225827 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.225791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 16:59:59.361290 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.361250 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7"] Jul 01 16:59:59.364059 ip-10-0-140-96 kubenswrapper[2577]: W0701 16:59:59.364031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e08b0d6_db97_405d_b95b_dad1b909afa2.slice/crio-d3e67488d18f0b2fa56ebd6c67d32dfb6480bd906eb30afb41f2c5086fa5a8e6 WatchSource:0}: Error finding container d3e67488d18f0b2fa56ebd6c67d32dfb6480bd906eb30afb41f2c5086fa5a8e6: Status 404 returned error can't find the container with id d3e67488d18f0b2fa56ebd6c67d32dfb6480bd906eb30afb41f2c5086fa5a8e6 Jul 01 16:59:59.387996 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.387943 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d" exitCode=0 Jul 01 16:59:59.387996 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.387989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d"} Jul 01 16:59:59.389471 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.389440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" event={"ID":"8e08b0d6-db97-405d-b95b-dad1b909afa2","Type":"ContainerStarted","Data":"d3e67488d18f0b2fa56ebd6c67d32dfb6480bd906eb30afb41f2c5086fa5a8e6"} Jul 01 16:59:59.391533 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.391511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bw99k" event={"ID":"47d241e6-d773-41ae-8157-69c5837339d7","Type":"ContainerStarted","Data":"99720ae1d1989a1c457ed11c91d1e03a33ae82f9c431c40b5bc6ab034d1684d2"} Jul 01 16:59:59.391636 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.391558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bw99k" event={"ID":"47d241e6-d773-41ae-8157-69c5837339d7","Type":"ContainerStarted","Data":"02da12a7db0a3a104ccb7d7e4bb1cdfad1f8394bc16cf3c9824336a4bba6fe8d"} Jul 01 16:59:59.451399 ip-10-0-140-96 kubenswrapper[2577]: I0701 16:59:59.451249 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bw99k" podStartSLOduration=3.139221125 podStartE2EDuration="5.45122893s" totalImagesPullingTime="2.20252755s" totalInitContainerRuntime="109.480255ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:59.450462598 +0000 UTC m=+104.985753058" watchObservedRunningTime="2026-07-01 16:59:59.45122893 +0000 UTC m=+104.986519354" Jul 01 17:00:01.402451 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.402408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" event={"ID":"8e08b0d6-db97-405d-b95b-dad1b909afa2","Type":"ContainerStarted","Data":"27040c31b6335425249910cfdf2db82ab7a21660ab73539f19ac91226e3d4af1"} Jul 01 17:00:01.402827 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.402608 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 17:00:01.407847 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.407822 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" Jul 01 17:00:01.419699 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.419670 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:00:01.423839 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.423819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.445209 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.445524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.445733 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.446121 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.446347 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.446505 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:00:01.446784 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.446650 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:00:01.449497 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.449289 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:00:01.449497 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.449434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:00:01.457050 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.457023 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:00:01.457221 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.457158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ecvvssi03hniq\"" Jul 01 17:00:01.457468 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.457390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:00:01.457468 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.457454 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:00:01.457998 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.457979 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h7q6p\"" Jul 01 17:00:01.460142 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.460122 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:00:01.460386 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.460371 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:00:01.472966 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.472920 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:00:01.515992 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.515946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516142 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516142 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-config\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516142 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhpjg\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-kube-api-access-xhpjg\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516307 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516307 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516307 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516307 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516307 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516802 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516802 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516802 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516802 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.516802 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.516740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.524526 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.524481 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wgzd7" podStartSLOduration=2.098155308 podStartE2EDuration="3.524466027s" totalImagesPullingTime="1.426310719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:01.473478796 +0000 UTC m=+107.008769222" watchObservedRunningTime="2026-07-01 17:00:01.524466027 +0000 UTC m=+107.059756469" Jul 01 17:00:01.539767 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.539735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:00:01.617645 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.617779 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.617779 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.617779 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.617779 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.617779 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-config\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhpjg\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-kube-api-access-xhpjg\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.617991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618057 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618418 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618418 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618418 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618418 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618418 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618418 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618706 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.618706 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.618640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.619728 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.619009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.619728 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.619336 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.619728 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.619556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.620933 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.620764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.622076 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.622034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.622568 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.622543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.623379 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.623337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.623461 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.623422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.623723 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.623700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.624090 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.624054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-config\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.624506 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.624476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.624506 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.624490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.624652 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.624603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.625270 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.625246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.625674 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.625650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.625757 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.625743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.626149 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.626127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.657577 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.657555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhpjg\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-kube-api-access-xhpjg\") pod \"prometheus-k8s-0\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.736015 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.735981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:01.940196 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:01.940172 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:00:01.941589 ip-10-0-140-96 kubenswrapper[2577]: W0701 17:00:01.941562 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6426f6b_132e_4172_be87_027bcaeae06f.slice/crio-7b6bda8a0986947a0905653d1bbd6ec71f1d06369251c57721931e57850f6bb7 WatchSource:0}: Error finding container 7b6bda8a0986947a0905653d1bbd6ec71f1d06369251c57721931e57850f6bb7: Status 404 returned error can't find the container with id 7b6bda8a0986947a0905653d1bbd6ec71f1d06369251c57721931e57850f6bb7 Jul 01 17:00:02.279041 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.279015 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d4c5d7d76-f6q4h" Jul 01 17:00:02.407664 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.407629 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" exitCode=0 Jul 01 17:00:02.408154 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.407711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} Jul 01 17:00:02.408154 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.407778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"7b6bda8a0986947a0905653d1bbd6ec71f1d06369251c57721931e57850f6bb7"} Jul 01 17:00:02.410969 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.410931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b"} Jul 01 17:00:02.411059 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.411001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468"} Jul 01 17:00:02.411059 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.411032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5"} Jul 01 17:00:02.411148 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.411062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd"} Jul 01 17:00:02.411148 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:02.411086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a"} Jul 01 17:00:04.423159 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:04.423119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerStarted","Data":"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9"} Jul 01 17:00:04.474442 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:04.474385 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.823748932 podStartE2EDuration="9.474363007s" totalImagesPullingTime="5.633662725s" totalInitContainerRuntime="16.95135ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:04.471722442 +0000 UTC m=+110.007012870" watchObservedRunningTime="2026-07-01 17:00:04.474363007 +0000 UTC m=+110.009653432" Jul 01 17:00:06.434837 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:06.434799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} Jul 01 17:00:06.435254 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:06.434909 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} Jul 01 17:00:07.381803 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:07.381769 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6gl52" Jul 01 17:00:08.447716 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:08.447688 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} Jul 01 17:00:08.448100 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:08.447749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} Jul 01 17:00:08.448100 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:08.447777 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} Jul 01 17:00:08.448100 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:08.447800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerStarted","Data":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} Jul 01 17:00:08.489845 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:08.489788 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.881430959 podStartE2EDuration="7.489771193s" totalImagesPullingTime="5.590932473s" totalInitContainerRuntime="17.407761ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:08.487313964 +0000 UTC m=+114.022604430" watchObservedRunningTime="2026-07-01 17:00:08.489771193 +0000 UTC m=+114.025061627" Jul 01 17:00:11.736775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:11.736718 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:24.737110 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:24.737046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 17:00:24.739524 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:24.739499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b2765d-53b9-4f4a-b4e6-88bd94cde305-metrics-certs\") pod \"network-metrics-daemon-mcrjd\" (UID: \"12b2765d-53b9-4f4a-b4e6-88bd94cde305\") " pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 17:00:25.018028 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.017995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8njwh\"" Jul 01 17:00:25.025219 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.025198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcrjd" Jul 01 17:00:25.240774 ip-10-0-140-96 kubenswrapper[2577]: W0701 17:00:25.240738 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b2765d_53b9_4f4a_b4e6_88bd94cde305.slice/crio-672a1bce40a071a09c10d336c3e9015f4644d65b46823d94d38c7a738478e3d3 WatchSource:0}: Error finding container 672a1bce40a071a09c10d336c3e9015f4644d65b46823d94d38c7a738478e3d3: Status 404 returned error can't find the container with id 672a1bce40a071a09c10d336c3e9015f4644d65b46823d94d38c7a738478e3d3 Jul 01 17:00:25.247741 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.247715 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mcrjd"] Jul 01 17:00:25.524536 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.524507 2577 generic.go:356] "Generic (PLEG): container finished" podID="baf63312-fea9-4a55-a3bf-05cf6b3ae7c2" containerID="9cb2b298536e4da92cdef46f55d9a590256c5a42417092bc93e57008e879f60a" exitCode=0 Jul 01 17:00:25.524731 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.524580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" event={"ID":"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2","Type":"ContainerDied","Data":"9cb2b298536e4da92cdef46f55d9a590256c5a42417092bc93e57008e879f60a"} Jul 01 17:00:25.525036 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.525017 2577 scope.go:117] "RemoveContainer" containerID="9cb2b298536e4da92cdef46f55d9a590256c5a42417092bc93e57008e879f60a" Jul 01 17:00:25.525791 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:25.525765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mcrjd" event={"ID":"12b2765d-53b9-4f4a-b4e6-88bd94cde305","Type":"ContainerStarted","Data":"672a1bce40a071a09c10d336c3e9015f4644d65b46823d94d38c7a738478e3d3"} Jul 01 17:00:26.543030 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:26.542990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-m6kh4" event={"ID":"baf63312-fea9-4a55-a3bf-05cf6b3ae7c2","Type":"ContainerStarted","Data":"2dda72c326c254dbbf1b9ff995a63b4276fb4a4b92848275236a40717c581670"} Jul 01 17:00:26.545479 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:26.545451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mcrjd" event={"ID":"12b2765d-53b9-4f4a-b4e6-88bd94cde305","Type":"ContainerStarted","Data":"98cf7c58d271ec25eabac2b327f2f7e5e74bf33ae5b95df34fe9071b9474f1b3"} Jul 01 17:00:26.720967 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:26.720934 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/init-config-reloader/0.log" Jul 01 17:00:26.729851 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:26.729822 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/alertmanager/0.log" Jul 01 17:00:26.852855 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:26.852827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/config-reloader/0.log" Jul 01 17:00:27.047716 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:27.047634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/kube-rbac-proxy-web/0.log" Jul 01 17:00:27.246656 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:27.246631 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/kube-rbac-proxy/0.log" Jul 01 17:00:27.448756 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:27.448734 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/kube-rbac-proxy-metric/0.log" Jul 01 17:00:27.551723 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:27.551688 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mcrjd" event={"ID":"12b2765d-53b9-4f4a-b4e6-88bd94cde305","Type":"ContainerStarted","Data":"aba8f27bb7709db18593de2df27ec9bb2cce06499588d089d5bd87e79e1b0121"} Jul 01 17:00:27.575333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:27.575280 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mcrjd" podStartSLOduration=131.414179629 podStartE2EDuration="2m12.575263865s" totalImagesPullingTime="1.161084236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:27.574759657 +0000 UTC m=+133.110050105" watchObservedRunningTime="2026-07-01 17:00:27.575263865 +0000 UTC m=+133.110554288" Jul 01 17:00:27.655390 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:27.655362 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e90b0301-fb35-4ef2-8f0d-f7632ea16d56/prom-label-proxy/0.log" Jul 01 17:00:28.051651 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:28.051580 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-585rl_0807c53d-f094-40bb-b29d-525d5e4470e8/kube-state-metrics/0.log" Jul 01 17:00:28.248161 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:28.248129 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-585rl_0807c53d-f094-40bb-b29d-525d5e4470e8/kube-rbac-proxy-main/0.log" Jul 01 17:00:28.446080 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:28.446054 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-585rl_0807c53d-f094-40bb-b29d-525d5e4470e8/kube-rbac-proxy-self/0.log" Jul 01 17:00:28.848635 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:28.848561 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-wgzd7_8e08b0d6-db97-405d-b95b-dad1b909afa2/monitoring-plugin/0.log" Jul 01 17:00:29.652840 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:29.652813 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bw99k_47d241e6-d773-41ae-8157-69c5837339d7/init-textfile/0.log" Jul 01 17:00:29.856603 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:29.856557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bw99k_47d241e6-d773-41ae-8157-69c5837339d7/node-exporter/0.log" Jul 01 17:00:30.048172 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:30.048118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bw99k_47d241e6-d773-41ae-8157-69c5837339d7/kube-rbac-proxy/0.log" Jul 01 17:00:30.846506 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:30.846432 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zrv86_aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c/kube-rbac-proxy-main/0.log" Jul 01 17:00:31.046300 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:31.046264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zrv86_aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c/kube-rbac-proxy-self/0.log" Jul 01 17:00:31.246530 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:31.246488 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zrv86_aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c/openshift-state-metrics/0.log" Jul 01 17:00:31.447014 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:31.446983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/init-config-reloader/0.log" Jul 01 17:00:31.649028 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:31.648937 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/prometheus/0.log" Jul 01 17:00:31.853920 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:31.853885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/config-reloader/0.log" Jul 01 17:00:32.047263 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:32.047235 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/thanos-sidecar/0.log" Jul 01 17:00:32.247083 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:32.247055 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/kube-rbac-proxy-web/0.log" Jul 01 17:00:32.445816 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:32.445791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/kube-rbac-proxy/0.log" Jul 01 17:00:32.648769 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:32.648738 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6426f6b-132e-4172-be87-027bcaeae06f/kube-rbac-proxy-thanos/0.log" Jul 01 17:00:33.250724 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:33.250695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-2wl2f_8a98a131-321b-4bdb-a33d-3528d91bbf0b/prometheus-operator-admission-webhook/0.log" Jul 01 17:00:34.646604 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:34.646572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-gpwhs_59b93481-8962-4420-8bd5-0d7ada24e8e8/networking-console-plugin/0.log" Jul 01 17:00:40.608910 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:40.608831 2577 generic.go:356] "Generic (PLEG): container finished" podID="b4e6878a-f353-4b28-9c7e-ad8703f72694" containerID="fea8a9a2d09639ec4207397b663806d69211bb74a6dfaaf185d4886fd21d34e9" exitCode=0 Jul 01 17:00:40.608910 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:40.608900 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" event={"ID":"b4e6878a-f353-4b28-9c7e-ad8703f72694","Type":"ContainerDied","Data":"fea8a9a2d09639ec4207397b663806d69211bb74a6dfaaf185d4886fd21d34e9"} Jul 01 17:00:40.609423 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:40.609335 2577 scope.go:117] "RemoveContainer" containerID="fea8a9a2d09639ec4207397b663806d69211bb74a6dfaaf185d4886fd21d34e9" Jul 01 17:00:41.615302 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:41.615266 2577 generic.go:356] "Generic (PLEG): container finished" podID="332c18f0-8843-4d02-9684-928484441559" containerID="16b4cc7ee4c9b6a3e12022f1c5037dc2b4968df6194042d014f4228b7ae33544" exitCode=0 Jul 01 17:00:41.615780 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:41.615342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" event={"ID":"332c18f0-8843-4d02-9684-928484441559","Type":"ContainerDied","Data":"16b4cc7ee4c9b6a3e12022f1c5037dc2b4968df6194042d014f4228b7ae33544"} Jul 01 17:00:41.615780 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:41.615712 2577 scope.go:117] "RemoveContainer" containerID="16b4cc7ee4c9b6a3e12022f1c5037dc2b4968df6194042d014f4228b7ae33544" Jul 01 17:00:41.617341 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:41.617320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-jn2xc" event={"ID":"b4e6878a-f353-4b28-9c7e-ad8703f72694","Type":"ContainerStarted","Data":"2a499cb3a6aac3d9e355e4369775f004a9ed7092417f841ec8eaf99972db5310"} Jul 01 17:00:42.624002 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:00:42.623944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-rt58m" event={"ID":"332c18f0-8843-4d02-9684-928484441559","Type":"ContainerStarted","Data":"90674997bf8e681d06179ce815b628b1214d68f69e2de04166612005c73c1e9e"} Jul 01 17:01:01.736657 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:01.736620 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:01.756341 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:01.756317 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:02.722114 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:02.722089 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:15.291389 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291293 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:15.291899 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291622 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="alertmanager" containerID="cri-o://1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a" gracePeriod=120 Jul 01 17:01:15.291899 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291705 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-metric" containerID="cri-o://0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b" gracePeriod=120 Jul 01 17:01:15.291899 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291748 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="config-reloader" containerID="cri-o://6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd" gracePeriod=120 Jul 01 17:01:15.291899 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291705 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-web" containerID="cri-o://9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5" gracePeriod=120 Jul 01 17:01:15.291899 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291769 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="prom-label-proxy" containerID="cri-o://73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9" gracePeriod=120 Jul 01 17:01:15.292186 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.291769 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy" containerID="cri-o://7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468" gracePeriod=120 Jul 01 17:01:15.352300 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:15.352259 2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90b0301_fb35_4ef2_8f0d_f7632ea16d56.slice/crio-conmon-6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd.scope\": RecentStats: unable to find data in memory cache]" Jul 01 17:01:15.761627 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761597 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9" exitCode=0 Jul 01 17:01:15.761627 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761622 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468" exitCode=0 Jul 01 17:01:15.761627 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761629 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd" exitCode=0 Jul 01 17:01:15.761627 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761636 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a" exitCode=0 Jul 01 17:01:15.761888 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9"} Jul 01 17:01:15.761888 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761728 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468"} Jul 01 17:01:15.761888 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd"} Jul 01 17:01:15.761888 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:15.761785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a"} Jul 01 17:01:16.549855 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.549828 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.694985 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.694922 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695154 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695025 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695154 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695061 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-volume\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695154 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695084 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-tls-assets\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695154 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695115 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-metrics-client-ca\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695364 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695196 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-out\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695364 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695255 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-main-db\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695364 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695286 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xd8f\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-kube-api-access-9xd8f\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695364 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695332 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-trusted-ca-bundle\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695364 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695360 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-cluster-tls-config\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695631 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695631 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695482 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-web-config\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695631 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695494 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:16.695631 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695510 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\" (UID: \"e90b0301-fb35-4ef2-8f0d-f7632ea16d56\") " Jul 01 17:01:16.695830 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695771 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-metrics-client-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.695919 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.695889 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:16.696279 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.696226 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:16.697876 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.697840 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.698289 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698216 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-volume" (OuterVolumeSpecName: "config-volume") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.698289 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698273 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.698429 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698290 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:16.698429 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698391 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.698531 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698480 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-out" (OuterVolumeSpecName: "config-out") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:16.698614 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698592 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.698844 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.698825 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-kube-api-access-9xd8f" (OuterVolumeSpecName: "kube-api-access-9xd8f") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "kube-api-access-9xd8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:16.703920 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.703894 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.710847 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.710816 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-web-config" (OuterVolumeSpecName: "web-config") pod "e90b0301-fb35-4ef2-8f0d-f7632ea16d56" (UID: "e90b0301-fb35-4ef2-8f0d-f7632ea16d56"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:16.768863 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.768831 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b" exitCode=0 Jul 01 17:01:16.768863 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.768856 2577 generic.go:356] "Generic (PLEG): container finished" podID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerID="9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5" exitCode=0 Jul 01 17:01:16.769138 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.768902 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.769138 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.768911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b"} Jul 01 17:01:16.769138 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.769043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5"} Jul 01 17:01:16.769138 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.769076 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e90b0301-fb35-4ef2-8f0d-f7632ea16d56","Type":"ContainerDied","Data":"bd0ddcac0d273a04f4564d69910d8cb5d18b82ce8c48f78a89cc00595e7e1f58"} Jul 01 17:01:16.769138 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.769114 2577 scope.go:117] "RemoveContainer" containerID="73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9" Jul 01 17:01:16.777795 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.777780 2577 scope.go:117] "RemoveContainer" containerID="0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b" Jul 01 17:01:16.785427 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.785410 2577 scope.go:117] "RemoveContainer" containerID="7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468" Jul 01 17:01:16.792406 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.792386 2577 scope.go:117] "RemoveContainer" containerID="9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5" Jul 01 17:01:16.796388 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796361 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-main-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796392 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-web-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796409 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796423 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796437 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796451 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-volume\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796463 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-tls-assets\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796474 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-config-out\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796487 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-main-db\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796499 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xd8f\" (UniqueName: \"kubernetes.io/projected/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-kube-api-access-9xd8f\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796512 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.796908 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.796525 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e90b0301-fb35-4ef2-8f0d-f7632ea16d56-cluster-tls-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:16.797888 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.797864 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:16.800368 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.800351 2577 scope.go:117] "RemoveContainer" containerID="6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd" Jul 01 17:01:16.806029 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.806008 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:16.809097 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.809082 2577 scope.go:117] "RemoveContainer" containerID="1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a" Jul 01 17:01:16.816678 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.816655 2577 scope.go:117] "RemoveContainer" containerID="4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d" Jul 01 17:01:16.824182 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.824162 2577 scope.go:117] "RemoveContainer" containerID="73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9" Jul 01 17:01:16.824467 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.824444 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9\": container with ID starting with 73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9 not found: ID does not exist" containerID="73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9" Jul 01 17:01:16.824528 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.824483 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9"} err="failed to get container status \"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9\": rpc error: code = NotFound desc = could not find container \"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9\": container with ID starting with 73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9 not found: ID does not exist" Jul 01 17:01:16.824612 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.824528 2577 scope.go:117] "RemoveContainer" containerID="0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b" Jul 01 17:01:16.824804 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.824787 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b\": container with ID starting with 0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b not found: ID does not exist" containerID="0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b" Jul 01 17:01:16.824845 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.824810 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b"} err="failed to get container status \"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b\": rpc error: code = NotFound desc = could not find container \"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b\": container with ID starting with 0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b not found: ID does not exist" Jul 01 17:01:16.824845 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.824831 2577 scope.go:117] "RemoveContainer" containerID="7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468" Jul 01 17:01:16.825103 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.825086 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468\": container with ID starting with 7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468 not found: ID does not exist" containerID="7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468" Jul 01 17:01:16.825165 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825108 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468"} err="failed to get container status \"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468\": rpc error: code = NotFound desc = could not find container \"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468\": container with ID starting with 7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468 not found: ID does not exist" Jul 01 17:01:16.825165 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825129 2577 scope.go:117] "RemoveContainer" containerID="9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5" Jul 01 17:01:16.825366 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.825350 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5\": container with ID starting with 9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5 not found: ID does not exist" containerID="9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5" Jul 01 17:01:16.825409 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825369 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5"} err="failed to get container status \"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5\": rpc error: code = NotFound desc = could not find container \"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5\": container with ID starting with 9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5 not found: ID does not exist" Jul 01 17:01:16.825409 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825382 2577 scope.go:117] "RemoveContainer" containerID="6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd" Jul 01 17:01:16.825566 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.825551 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd\": container with ID starting with 6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd not found: ID does not exist" containerID="6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd" Jul 01 17:01:16.825605 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825569 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd"} err="failed to get container status \"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd\": rpc error: code = NotFound desc = could not find container \"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd\": container with ID starting with 6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd not found: ID does not exist" Jul 01 17:01:16.825605 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825581 2577 scope.go:117] "RemoveContainer" containerID="1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a" Jul 01 17:01:16.825797 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.825781 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a\": container with ID starting with 1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a not found: ID does not exist" containerID="1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a" Jul 01 17:01:16.825853 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825804 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a"} err="failed to get container status \"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a\": rpc error: code = NotFound desc = could not find container \"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a\": container with ID starting with 1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a not found: ID does not exist" Jul 01 17:01:16.825853 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.825827 2577 scope.go:117] "RemoveContainer" containerID="4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d" Jul 01 17:01:16.826116 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:16.826094 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d\": container with ID starting with 4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d not found: ID does not exist" containerID="4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d" Jul 01 17:01:16.826175 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826120 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d"} err="failed to get container status \"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d\": rpc error: code = NotFound desc = could not find container \"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d\": container with ID starting with 4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d not found: ID does not exist" Jul 01 17:01:16.826175 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826134 2577 scope.go:117] "RemoveContainer" containerID="73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9" Jul 01 17:01:16.826348 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826330 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9"} err="failed to get container status \"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9\": rpc error: code = NotFound desc = could not find container \"73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9\": container with ID starting with 73ffbebe0c313bb055571d82526230fde722cbf19f8cf90cde9fa3579a6fdff9 not found: ID does not exist" Jul 01 17:01:16.826393 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826349 2577 scope.go:117] "RemoveContainer" containerID="0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b" Jul 01 17:01:16.826524 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826508 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b"} err="failed to get container status \"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b\": rpc error: code = NotFound desc = could not find container \"0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b\": container with ID starting with 0fb179025e6af3d90bba64ce66d6c3f624ae99c309c7fe989c8b34e34735497b not found: ID does not exist" Jul 01 17:01:16.826567 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826525 2577 scope.go:117] "RemoveContainer" containerID="7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468" Jul 01 17:01:16.826711 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826692 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468"} err="failed to get container status \"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468\": rpc error: code = NotFound desc = could not find container \"7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468\": container with ID starting with 7991b25d1bd5bd01405bcc6dd858dc9bb12fa7e8464ababaf230fe699d375468 not found: ID does not exist" Jul 01 17:01:16.826753 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826712 2577 scope.go:117] "RemoveContainer" containerID="9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5" Jul 01 17:01:16.826940 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826924 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5"} err="failed to get container status \"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5\": rpc error: code = NotFound desc = could not find container \"9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5\": container with ID starting with 9f6689bba2bfa6c12c50342d093945604976a267e4575af31273d58f5cdbced5 not found: ID does not exist" Jul 01 17:01:16.827030 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.826940 2577 scope.go:117] "RemoveContainer" containerID="6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd" Jul 01 17:01:16.827178 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.827161 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd"} err="failed to get container status \"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd\": rpc error: code = NotFound desc = could not find container \"6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd\": container with ID starting with 6f16828ec51e03fe0bcf9bce0867b3b846b8f61bdf320b45d24d6047480264cd not found: ID does not exist" Jul 01 17:01:16.827227 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.827178 2577 scope.go:117] "RemoveContainer" containerID="1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a" Jul 01 17:01:16.827360 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.827345 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a"} err="failed to get container status \"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a\": rpc error: code = NotFound desc = could not find container \"1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a\": container with ID starting with 1a41aad6e77dea5e058b23f2eff4f3c5e1d0570177b41313f1bb2dfcf9f68a6a not found: ID does not exist" Jul 01 17:01:16.827402 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.827360 2577 scope.go:117] "RemoveContainer" containerID="4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d" Jul 01 17:01:16.827549 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.827533 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d"} err="failed to get container status \"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d\": rpc error: code = NotFound desc = could not find container \"4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d\": container with ID starting with 4835f4dac171b827868affac7bc47032a34301be3b8997a445366f9ca3de4f4d not found: ID does not exist" Jul 01 17:01:16.858572 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858533 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:16.858851 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858839 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="prom-label-proxy" Jul 01 17:01:16.858851 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858852 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="prom-label-proxy" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858871 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858877 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858885 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="config-reloader" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858892 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="config-reloader" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858897 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-metric" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858904 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-metric" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858911 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="alertmanager" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858915 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="alertmanager" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858922 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-web" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858927 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-web" Jul 01 17:01:16.858932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858936 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="init-config-reloader" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.858941 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="init-config-reloader" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.859005 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="alertmanager" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.859014 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-web" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.859020 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy-metric" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.859026 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="prom-label-proxy" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.859033 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="config-reloader" Jul 01 17:01:16.859271 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.859038 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" containerName="kube-rbac-proxy" Jul 01 17:01:16.863159 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.863138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.869514 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:01:16.869514 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869453 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:01:16.869648 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:01:16.869785 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869766 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:01:16.869875 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rf7md\"" Jul 01 17:01:16.869875 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869763 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:01:16.870017 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:01:16.870017 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.869908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:01:16.870182 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.870168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:01:16.878009 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.877992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:01:16.892849 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.892819 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:16.908838 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.908806 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e90b0301-fb35-4ef2-8f0d-f7632ea16d56" path="/var/lib/kubelet/pods/e90b0301-fb35-4ef2-8f0d-f7632ea16d56/volumes" Jul 01 17:01:16.998755 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.998755 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-web-config\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.998937 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.998937 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.998937 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.998937 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wflc6\" (UniqueName: \"kubernetes.io/projected/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-kube-api-access-wflc6\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.998943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.999009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.999034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.999053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.999074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.999099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-config-out\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:16.999157 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:16.999118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.099880 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.099832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-web-config\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100078 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.099889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100078 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.099916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100078 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.099943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100216 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wflc6\" (UniqueName: \"kubernetes.io/projected/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-kube-api-access-wflc6\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100216 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100216 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100216 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100413 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100413 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100413 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-config-out\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100413 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100413 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.100998 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.100944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.101116 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.101012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.101174 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.101156 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103084 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-web-config\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103485 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103485 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103729 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103729 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103857 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103857 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-config-out\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.103939 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.103916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.104582 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.104563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.111910 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.111889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wflc6\" (UniqueName: \"kubernetes.io/projected/5ef83c02-4229-4141-9ec4-8e90aa3cd11f-kube-api-access-wflc6\") pod \"alertmanager-main-0\" (UID: \"5ef83c02-4229-4141-9ec4-8e90aa3cd11f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.172866 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.172824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:17.321999 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.321948 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:17.325078 ip-10-0-140-96 kubenswrapper[2577]: W0701 17:01:17.325048 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef83c02_4229_4141_9ec4_8e90aa3cd11f.slice/crio-4b2cfbb88b718a3671c71eddc6789536463af7ae27afe9b8200625a166014f67 WatchSource:0}: Error finding container 4b2cfbb88b718a3671c71eddc6789536463af7ae27afe9b8200625a166014f67: Status 404 returned error can't find the container with id 4b2cfbb88b718a3671c71eddc6789536463af7ae27afe9b8200625a166014f67 Jul 01 17:01:17.775780 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.775745 2577 generic.go:356] "Generic (PLEG): container finished" podID="5ef83c02-4229-4141-9ec4-8e90aa3cd11f" containerID="a5e8108588fae7db6deb772c51125a35e30e69e1165f25788caf167a4e6623a2" exitCode=0 Jul 01 17:01:17.776216 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.775823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerDied","Data":"a5e8108588fae7db6deb772c51125a35e30e69e1165f25788caf167a4e6623a2"} Jul 01 17:01:17.776216 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:17.775915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"4b2cfbb88b718a3671c71eddc6789536463af7ae27afe9b8200625a166014f67"} Jul 01 17:01:18.783534 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.783501 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"7fe7ab3ecb1d94858496b21e92377c07931e4d86ff5e4daae135b60477105ccd"} Jul 01 17:01:18.783927 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.783591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"f4880e7105eb8f81cac7c7f6a29643605fd9b44c12e795921ecc80b16f9bf932"} Jul 01 17:01:18.783927 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.783620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"a812e3c3afda40b6a3fbe68efaea0a284f1e8da6970c9cfc92bc8cbc356546f4"} Jul 01 17:01:18.783927 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.783644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"50017b868fdb8d58d21d949eb39cf506643731aeff565f604b690b19e07297f7"} Jul 01 17:01:18.783927 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.783668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"6b545f8e865252a4238c461816af419f1873e6891cf8551d49cac26d9a5ff73c"} Jul 01 17:01:18.783927 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.783689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ef83c02-4229-4141-9ec4-8e90aa3cd11f","Type":"ContainerStarted","Data":"e3b0ab30675ef3bdcec7a9aee298089ef8894ea2cc31153ee8ac014eb18f0cda"} Jul 01 17:01:18.813697 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:18.813402 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.79641932 podStartE2EDuration="2.813381411s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.962091ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:01:18.812730376 +0000 UTC m=+184.348020799" watchObservedRunningTime="2026-07-01 17:01:18.813381411 +0000 UTC m=+184.348671836" Jul 01 17:01:19.701663 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.701622 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:19.702012 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.701950 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="prometheus" containerID="cri-o://4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" gracePeriod=600 Jul 01 17:01:19.702122 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.701995 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy" containerID="cri-o://77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" gracePeriod=600 Jul 01 17:01:19.702122 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.702018 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" gracePeriod=600 Jul 01 17:01:19.702122 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.702060 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="config-reloader" containerID="cri-o://cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" gracePeriod=600 Jul 01 17:01:19.702122 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.702025 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="thanos-sidecar" containerID="cri-o://613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" gracePeriod=600 Jul 01 17:01:19.702336 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.702027 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-web" containerID="cri-o://6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" gracePeriod=600 Jul 01 17:01:19.956204 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:19.956141 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:20.131714 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131672 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhpjg\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-kube-api-access-xhpjg\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131714 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131713 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131738 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-config\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131755 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-db\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131775 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131810 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-0\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131849 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-web-config\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131887 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-kube-rbac-proxy\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131914 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-config-out\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.131995 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.131940 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-metrics-client-ca\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132000 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-thanos-prometheus-http-client-file\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132046 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-trusted-ca-bundle\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132069 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-serving-certs-ca-bundle\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132103 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-tls\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132133 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-2\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132171 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-1\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132194 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-kubelet-serving-ca-bundle\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132225 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-metrics-client-certs\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132262 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-tls-assets\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.132449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.132305 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-grpc-tls\") pod \"a6426f6b-132e-4172-be87-027bcaeae06f\" (UID: \"a6426f6b-132e-4172-be87-027bcaeae06f\") " Jul 01 17:01:20.133985 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.133519 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.133985 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.133864 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:20.134541 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.134224 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.134541 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.134381 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.134541 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.134414 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-kube-api-access-xhpjg" (OuterVolumeSpecName: "kube-api-access-xhpjg") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "kube-api-access-xhpjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:20.134541 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.134478 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.134807 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.134762 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.134866 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.134844 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.135253 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.135180 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.135253 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.135204 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-config" (OuterVolumeSpecName: "config") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.136197 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.135497 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.136197 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.135894 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.136373 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.136342 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.136489 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.136460 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:20.136669 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.136653 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.136913 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.136895 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.137152 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.137135 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-config-out" (OuterVolumeSpecName: "config-out") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:20.137420 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.137397 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.137532 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.137514 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:20.146019 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.145990 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-web-config" (OuterVolumeSpecName: "web-config") pod "a6426f6b-132e-4172-be87-027bcaeae06f" (UID: "a6426f6b-132e-4172-be87-027bcaeae06f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233686 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-metrics-client-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233718 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-tls-assets\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233728 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-grpc-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233737 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhpjg\" (UniqueName: \"kubernetes.io/projected/a6426f6b-132e-4172-be87-027bcaeae06f-kube-api-access-xhpjg\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233749 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233758 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233767 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-db\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233777 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.233775 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233785 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233794 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-web-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233803 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-kube-rbac-proxy\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233811 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6426f6b-132e-4172-be87-027bcaeae06f-config-out\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233819 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-metrics-client-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233827 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233835 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233843 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233852 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6426f6b-132e-4172-be87-027bcaeae06f-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233860 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233868 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.234226 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.233876 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6426f6b-132e-4172-be87-027bcaeae06f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:01:20.797914 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797873 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" exitCode=0 Jul 01 17:01:20.797914 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797903 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" exitCode=0 Jul 01 17:01:20.797914 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797909 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" exitCode=0 Jul 01 17:01:20.797914 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797916 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" exitCode=0 Jul 01 17:01:20.797914 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797921 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" exitCode=0 Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797930 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6426f6b-132e-4172-be87-027bcaeae06f" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" exitCode=0 Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797943 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.797942 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6426f6b-132e-4172-be87-027bcaeae06f","Type":"ContainerDied","Data":"7b6bda8a0986947a0905653d1bbd6ec71f1d06369251c57721931e57850f6bb7"} Jul 01 17:01:20.798333 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.798103 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.806496 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.806477 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.814364 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.814343 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.821549 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.821532 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.823680 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.823654 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:20.829113 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.829083 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:20.830986 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.830970 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.838310 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.838291 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.845927 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.845911 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.853173 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.853150 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.853445 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.853426 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.853496 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.853455 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} err="failed to get container status \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" Jul 01 17:01:20.853496 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.853474 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.853729 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.853704 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.853834 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.853734 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} err="failed to get container status \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" Jul 01 17:01:20.853834 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.853751 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.854034 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.853996 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.854134 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854038 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} err="failed to get container status \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" Jul 01 17:01:20.854134 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854058 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.854322 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.854307 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.854379 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854328 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} err="failed to get container status \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" Jul 01 17:01:20.854379 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854341 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.854551 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.854537 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.854592 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854554 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} err="failed to get container status \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" Jul 01 17:01:20.854592 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854566 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.854752 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.854738 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.854791 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854760 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} err="failed to get container status \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" Jul 01 17:01:20.854791 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854775 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.854985 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:01:20.854945 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.855079 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.854988 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} err="failed to get container status \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" Jul 01 17:01:20.855079 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855003 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.855232 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855216 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} err="failed to get container status \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" Jul 01 17:01:20.855276 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855234 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.855472 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855451 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} err="failed to get container status \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" Jul 01 17:01:20.855472 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855471 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.855675 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855660 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} err="failed to get container status \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" Jul 01 17:01:20.855719 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855675 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.855862 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855846 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} err="failed to get container status \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" Jul 01 17:01:20.855905 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.855862 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.856098 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856080 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} err="failed to get container status \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" Jul 01 17:01:20.856098 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856098 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.856304 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856288 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} err="failed to get container status \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" Jul 01 17:01:20.856359 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856306 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.856510 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856493 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} err="failed to get container status \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" Jul 01 17:01:20.856560 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856509 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.856705 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856686 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} err="failed to get container status \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" Jul 01 17:01:20.856750 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856707 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.856906 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856890 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} err="failed to get container status \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" Jul 01 17:01:20.856906 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.856906 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.857148 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.857130 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} err="failed to get container status \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" Jul 01 17:01:20.857148 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.857147 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.857388 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.857365 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} err="failed to get container status \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" Jul 01 17:01:20.857388 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.857385 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.857827 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.857780 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} err="failed to get container status \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" Jul 01 17:01:20.857942 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.857828 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.858253 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.858230 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} err="failed to get container status \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" Jul 01 17:01:20.858336 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.858255 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.858541 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.858519 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} err="failed to get container status \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" Jul 01 17:01:20.858667 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.858544 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.858828 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.858806 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} err="failed to get container status \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" Jul 01 17:01:20.858914 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.858829 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.859090 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859068 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} err="failed to get container status \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" Jul 01 17:01:20.859144 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859092 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.859330 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859311 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} err="failed to get container status \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" Jul 01 17:01:20.859387 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859332 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.859542 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859523 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} err="failed to get container status \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" Jul 01 17:01:20.859588 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859542 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.859780 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859762 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} err="failed to get container status \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" Jul 01 17:01:20.859855 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.859781 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.860031 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860007 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:20.860078 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860035 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} err="failed to get container status \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" Jul 01 17:01:20.860078 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860052 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.860275 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860247 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} err="failed to get container status \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" Jul 01 17:01:20.860275 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860270 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.860388 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860373 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="thanos-sidecar" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860389 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="thanos-sidecar" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860403 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="init-config-reloader" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860409 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="init-config-reloader" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860415 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860421 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860431 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-thanos" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860439 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-thanos" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860448 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="config-reloader" Jul 01 17:01:20.860452 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860455 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="config-reloader" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860464 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-web" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860470 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-web" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860489 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="prometheus" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860494 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="prometheus" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860488 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} err="failed to get container status \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860505 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860542 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="prometheus" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860550 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="thanos-sidecar" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860556 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-web" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860563 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy-thanos" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860572 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="config-reloader" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860582 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" containerName="kube-rbac-proxy" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860699 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} err="failed to get container status \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" Jul 01 17:01:20.860777 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860722 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.861491 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860907 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} err="failed to get container status \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" Jul 01 17:01:20.861491 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.860925 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.861491 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.861146 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} err="failed to get container status \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" Jul 01 17:01:20.861491 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.861170 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.861997 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.861946 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} err="failed to get container status \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" Jul 01 17:01:20.862110 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.861998 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.862568 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.862541 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} err="failed to get container status \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" Jul 01 17:01:20.862686 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.862678 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.863231 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.863205 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} err="failed to get container status \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" Jul 01 17:01:20.863343 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.863232 2577 scope.go:117] "RemoveContainer" containerID="686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466" Jul 01 17:01:20.863683 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.863652 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466"} err="failed to get container status \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": rpc error: code = NotFound desc = could not find container \"686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466\": container with ID starting with 686b2befe7047fdbf78e29b8e084197fb6a475674a5341f28f27408d928b0466 not found: ID does not exist" Jul 01 17:01:20.863781 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.863686 2577 scope.go:117] "RemoveContainer" containerID="77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814" Jul 01 17:01:20.864118 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.864093 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814"} err="failed to get container status \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": rpc error: code = NotFound desc = could not find container \"77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814\": container with ID starting with 77f5c2a9d31a72f4fd65114a5f4bf568fa624471039c449a0bda7e4fac88f814 not found: ID does not exist" Jul 01 17:01:20.864235 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.864120 2577 scope.go:117] "RemoveContainer" containerID="6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c" Jul 01 17:01:20.864555 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.864527 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c"} err="failed to get container status \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": rpc error: code = NotFound desc = could not find container \"6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c\": container with ID starting with 6e98ee1fff8e24249dbadeedc50451358b7715f5c5c9e8ea75348b5a2984391c not found: ID does not exist" Jul 01 17:01:20.864656 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.864558 2577 scope.go:117] "RemoveContainer" containerID="613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21" Jul 01 17:01:20.864947 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.864924 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21"} err="failed to get container status \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": rpc error: code = NotFound desc = could not find container \"613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21\": container with ID starting with 613c3f4b32b6fbcf1d261b1e3bc3325f599028104294c0dbf14ffb8855a50d21 not found: ID does not exist" Jul 01 17:01:20.865084 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.864949 2577 scope.go:117] "RemoveContainer" containerID="cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd" Jul 01 17:01:20.865387 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.865365 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd"} err="failed to get container status \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": rpc error: code = NotFound desc = could not find container \"cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd\": container with ID starting with cc60b49c0eea147fcc1e71a309a0b57cec21da6c3e02da8ec4124df6edb289dd not found: ID does not exist" Jul 01 17:01:20.865387 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.865389 2577 scope.go:117] "RemoveContainer" containerID="4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376" Jul 01 17:01:20.865752 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.865729 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376"} err="failed to get container status \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": rpc error: code = NotFound desc = could not find container \"4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376\": container with ID starting with 4a583f0894753b5a80b1ee3a6d9451b50a3db3c1206290c755a74fc11726e376 not found: ID does not exist" Jul 01 17:01:20.865851 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.865753 2577 scope.go:117] "RemoveContainer" containerID="1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f" Jul 01 17:01:20.866081 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.866058 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f"} err="failed to get container status \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": rpc error: code = NotFound desc = could not find container \"1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f\": container with ID starting with 1fdd5e718e197e52950f4f522517e123f2985f06c026f0775508b2d1e2346a6f not found: ID does not exist" Jul 01 17:01:20.868075 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.868057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:20.870749 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:01:20.870892 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:01:20.870892 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870824 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ecvvssi03hniq\"" Jul 01 17:01:20.870892 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:01:20.871133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:01:20.871133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870906 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:01:20.871133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870908 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:01:20.871133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.870981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:01:20.871133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.871018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:01:20.871371 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.871162 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h7q6p\"" Jul 01 17:01:20.871447 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.871430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:01:20.871506 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.871476 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:01:20.871696 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.871680 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:01:20.871812 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.871797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:01:20.873097 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.873077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:01:20.874220 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.874199 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:01:20.876727 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.876711 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:01:20.881795 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.881773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:20.908070 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:20.908040 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6426f6b-132e-4172-be87-027bcaeae06f" path="/var/lib/kubelet/pods/a6426f6b-132e-4172-be87-027bcaeae06f/volumes" Jul 01 17:01:21.042636 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.042636 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-web-config\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.042636 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4w8c\" (UniqueName: \"kubernetes.io/projected/e35d2c51-36dc-492b-a7f2-9f23d47e8713-kube-api-access-w4w8c\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.042948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-config\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.043011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35d2c51-36dc-492b-a7f2-9f23d47e8713-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.043029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.043048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043106 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.043069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043546 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.043132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35d2c51-36dc-492b-a7f2-9f23d47e8713-config-out\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.043546 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.043160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.143978 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.143915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.143978 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.143976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.143996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-config\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35d2c51-36dc-492b-a7f2-9f23d47e8713-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144170 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35d2c51-36dc-492b-a7f2-9f23d47e8713-config-out\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-web-config\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4w8c\" (UniqueName: \"kubernetes.io/projected/e35d2c51-36dc-492b-a7f2-9f23d47e8713-kube-api-access-w4w8c\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.144557 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.145153 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.145153 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.145153 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.145153 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.144901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.146736 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.145873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.146736 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.146602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.147298 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.147219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35d2c51-36dc-492b-a7f2-9f23d47e8713-config-out\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.147397 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.147311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.147397 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.147381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35d2c51-36dc-492b-a7f2-9f23d47e8713-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.148147 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.147841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.148147 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.147845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.148147 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.147890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-web-config\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.148450 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.148421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e35d2c51-36dc-492b-a7f2-9f23d47e8713-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.149124 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.149098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-config\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.149346 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.149327 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.149631 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.149611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.149831 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.149808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.150365 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.150347 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.150417 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.150370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35d2c51-36dc-492b-a7f2-9f23d47e8713-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.154651 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.154630 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4w8c\" (UniqueName: \"kubernetes.io/projected/e35d2c51-36dc-492b-a7f2-9f23d47e8713-kube-api-access-w4w8c\") pod \"prometheus-k8s-0\" (UID: \"e35d2c51-36dc-492b-a7f2-9f23d47e8713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.178613 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.178573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:21.323049 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.323023 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:21.325408 ip-10-0-140-96 kubenswrapper[2577]: W0701 17:01:21.325385 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35d2c51_36dc_492b_a7f2_9f23d47e8713.slice/crio-54984979c82b618b91b946cbd1448c9f05c0958007d8c9a40ee8ddf86ad9096b WatchSource:0}: Error finding container 54984979c82b618b91b946cbd1448c9f05c0958007d8c9a40ee8ddf86ad9096b: Status 404 returned error can't find the container with id 54984979c82b618b91b946cbd1448c9f05c0958007d8c9a40ee8ddf86ad9096b Jul 01 17:01:21.804571 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.804536 2577 generic.go:356] "Generic (PLEG): container finished" podID="e35d2c51-36dc-492b-a7f2-9f23d47e8713" containerID="907e773d8fcf8abe10ea3ae2a3dd6efc533d209945d2d009a7c60d0bf16fccdf" exitCode=0 Jul 01 17:01:21.804746 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.804620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerDied","Data":"907e773d8fcf8abe10ea3ae2a3dd6efc533d209945d2d009a7c60d0bf16fccdf"} Jul 01 17:01:21.804746 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:21.804682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"54984979c82b618b91b946cbd1448c9f05c0958007d8c9a40ee8ddf86ad9096b"} Jul 01 17:01:22.811720 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.811681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"26a2dedeb899174bca2af949ea4d0aba530277ee3f80ef64f56497f8be0918d6"} Jul 01 17:01:22.812133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.811746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"a451709e74e5ce6f37e77682f9a4d020fd13d95e4f0670e4f331648b325cdbea"} Jul 01 17:01:22.812133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.811773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"a36e4bcd67343328b4520af5fa296415c902ae402633900695c498447ccd8f6c"} Jul 01 17:01:22.812133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.811797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"99dc6da0149046f077c66d5db6f35cc347a6b5bf4cb2332419acda5ca9dc19bb"} Jul 01 17:01:22.812133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.811821 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"d75741eed513df4780836cf636481f7c90e341ea951380fde516bdf29288a1b0"} Jul 01 17:01:22.812133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.811853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e35d2c51-36dc-492b-a7f2-9f23d47e8713","Type":"ContainerStarted","Data":"5b26334e8966f31e2270556004b5f7e7e42fd4015dd77313e6adbe76e6bf7fa0"} Jul 01 17:01:22.845860 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:22.845805 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.825693792 podStartE2EDuration="2.845785051s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.091259ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:01:22.842831934 +0000 UTC m=+188.378122358" watchObservedRunningTime="2026-07-01 17:01:22.845785051 +0000 UTC m=+188.381075475" Jul 01 17:01:26.179390 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:01:26.179351 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:02:21.179548 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:02:21.179506 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:02:21.195484 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:02:21.195457 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:02:22.078215 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:02:22.078191 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:03:14.856444 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:03:14.856414 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:03:14.859881 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:03:14.859860 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:03:14.861321 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:03:14.861303 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 17:06:56.716392 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.716354 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-frwv8"] Jul 01 17:06:56.719773 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.719756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-frwv8" Jul 01 17:06:56.722489 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.722465 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 17:06:56.722611 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.722509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-8sxwj\"" Jul 01 17:06:56.723502 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.723482 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 17:06:56.723592 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.723537 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 17:06:56.732187 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.732165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-frwv8"] Jul 01 17:06:56.844640 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.844595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2bp\" (UniqueName: \"kubernetes.io/projected/9cf1302b-923d-4b74-9e63-fe62f4e96f12-kube-api-access-dl2bp\") pod \"s3-init-frwv8\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " pod="kserve/s3-init-frwv8" Jul 01 17:06:56.844640 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.844643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf1302b-923d-4b74-9e63-fe62f4e96f12-model-cache\") pod \"s3-init-frwv8\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " pod="kserve/s3-init-frwv8" Jul 01 17:06:56.945731 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.945701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2bp\" (UniqueName: \"kubernetes.io/projected/9cf1302b-923d-4b74-9e63-fe62f4e96f12-kube-api-access-dl2bp\") pod \"s3-init-frwv8\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " pod="kserve/s3-init-frwv8" Jul 01 17:06:56.945891 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.945742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf1302b-923d-4b74-9e63-fe62f4e96f12-model-cache\") pod \"s3-init-frwv8\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " pod="kserve/s3-init-frwv8" Jul 01 17:06:56.946134 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.946117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf1302b-923d-4b74-9e63-fe62f4e96f12-model-cache\") pod \"s3-init-frwv8\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " pod="kserve/s3-init-frwv8" Jul 01 17:06:56.956311 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:56.956295 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2bp\" (UniqueName: \"kubernetes.io/projected/9cf1302b-923d-4b74-9e63-fe62f4e96f12-kube-api-access-dl2bp\") pod \"s3-init-frwv8\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " pod="kserve/s3-init-frwv8" Jul 01 17:06:57.038370 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:57.038289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-frwv8" Jul 01 17:06:57.172211 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:57.172189 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-frwv8"] Jul 01 17:06:57.174138 ip-10-0-140-96 kubenswrapper[2577]: W0701 17:06:57.174110 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cf1302b_923d_4b74_9e63_fe62f4e96f12.slice/crio-c8c27d8e20ebbec4cbfc5ca43328f929fd4f4687ede7473f210b857d1b960abd WatchSource:0}: Error finding container c8c27d8e20ebbec4cbfc5ca43328f929fd4f4687ede7473f210b857d1b960abd: Status 404 returned error can't find the container with id c8c27d8e20ebbec4cbfc5ca43328f929fd4f4687ede7473f210b857d1b960abd Jul 01 17:06:57.176144 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:57.176130 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:06:57.191831 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:06:57.191802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-frwv8" event={"ID":"9cf1302b-923d-4b74-9e63-fe62f4e96f12","Type":"ContainerStarted","Data":"c8c27d8e20ebbec4cbfc5ca43328f929fd4f4687ede7473f210b857d1b960abd"} Jul 01 17:07:01.209149 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:07:01.209117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-frwv8" event={"ID":"9cf1302b-923d-4b74-9e63-fe62f4e96f12","Type":"ContainerStarted","Data":"55df78934e20fdca094c85b61a15491312ac5f0b5e37d5e2e2794cd96ef87753"} Jul 01 17:07:03.219320 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:07:03.219288 2577 generic.go:356] "Generic (PLEG): container finished" podID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerID="55df78934e20fdca094c85b61a15491312ac5f0b5e37d5e2e2794cd96ef87753" exitCode=0 Jul 01 17:07:03.219712 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:07:03.219378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-frwv8" event={"ID":"9cf1302b-923d-4b74-9e63-fe62f4e96f12","Type":"ContainerDied","Data":"55df78934e20fdca094c85b61a15491312ac5f0b5e37d5e2e2794cd96ef87753"} Jul 01 17:07:08.247225 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:07:08.247139 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-frwv8" event={"ID":"9cf1302b-923d-4b74-9e63-fe62f4e96f12","Type":"ContainerStarted","Data":"3426dcbd9289322e85c811102097873522dfbc09f590bba3d5da5021eeafa28f"} Jul 01 17:07:08.270144 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:07:08.270094 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-frwv8" podStartSLOduration=2.110563781 podStartE2EDuration="12.270076401s" totalImagesPullingTime="8.525459992s" totalInitContainerRuntime="1.634052628s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:06:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:07:08.268631083 +0000 UTC m=+533.803921561" watchObservedRunningTime="2026-07-01 17:07:08.270076401 +0000 UTC m=+533.805367067" Jul 01 17:08:13.513207 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:13.513173 2577 generic.go:356] "Generic (PLEG): container finished" podID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerID="3426dcbd9289322e85c811102097873522dfbc09f590bba3d5da5021eeafa28f" exitCode=0 Jul 01 17:08:13.513623 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:13.513246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-frwv8" event={"ID":"9cf1302b-923d-4b74-9e63-fe62f4e96f12","Type":"ContainerDied","Data":"3426dcbd9289322e85c811102097873522dfbc09f590bba3d5da5021eeafa28f"} Jul 01 17:08:14.641495 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.641470 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-frwv8" Jul 01 17:08:14.699991 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.699936 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl2bp\" (UniqueName: \"kubernetes.io/projected/9cf1302b-923d-4b74-9e63-fe62f4e96f12-kube-api-access-dl2bp\") pod \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " Jul 01 17:08:14.699991 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.699998 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf1302b-923d-4b74-9e63-fe62f4e96f12-model-cache\") pod \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\" (UID: \"9cf1302b-923d-4b74-9e63-fe62f4e96f12\") " Jul 01 17:08:14.702122 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.702095 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf1302b-923d-4b74-9e63-fe62f4e96f12-kube-api-access-dl2bp" (OuterVolumeSpecName: "kube-api-access-dl2bp") pod "9cf1302b-923d-4b74-9e63-fe62f4e96f12" (UID: "9cf1302b-923d-4b74-9e63-fe62f4e96f12"). InnerVolumeSpecName "kube-api-access-dl2bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:08:14.718761 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.718717 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf1302b-923d-4b74-9e63-fe62f4e96f12-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cf1302b-923d-4b74-9e63-fe62f4e96f12" (UID: "9cf1302b-923d-4b74-9e63-fe62f4e96f12"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:08:14.801533 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.801451 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl2bp\" (UniqueName: \"kubernetes.io/projected/9cf1302b-923d-4b74-9e63-fe62f4e96f12-kube-api-access-dl2bp\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:08:14.801533 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.801482 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf1302b-923d-4b74-9e63-fe62f4e96f12-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:08:14.889124 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.889095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:08:14.889303 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:14.889095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:08:15.523464 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:15.523428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-frwv8" event={"ID":"9cf1302b-923d-4b74-9e63-fe62f4e96f12","Type":"ContainerDied","Data":"c8c27d8e20ebbec4cbfc5ca43328f929fd4f4687ede7473f210b857d1b960abd"} Jul 01 17:08:15.523464 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:15.523443 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-frwv8" Jul 01 17:08:15.523464 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:08:15.523465 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8c27d8e20ebbec4cbfc5ca43328f929fd4f4687ede7473f210b857d1b960abd" Jul 01 17:13:14.922920 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:13:14.922836 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:13:14.924208 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:13:14.924186 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:18:14.952030 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:18:14.951998 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:18:14.956853 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:18:14.956832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:23:14.977971 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:23:14.977925 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:23:14.983872 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:23:14.983850 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:24:09.789932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.789896 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-md8rj/must-gather-p5552"] Jul 01 17:24:09.790459 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.790252 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerName="download-hf-model" Jul 01 17:24:09.790459 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.790263 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerName="download-hf-model" Jul 01 17:24:09.790459 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.790274 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerName="s3-init" Jul 01 17:24:09.790459 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.790279 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerName="s3-init" Jul 01 17:24:09.790459 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.790342 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf1302b-923d-4b74-9e63-fe62f4e96f12" containerName="s3-init" Jul 01 17:24:09.793349 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.793331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:09.796308 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.796283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-md8rj\"/\"openshift-service-ca.crt\"" Jul 01 17:24:09.796394 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.796341 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-md8rj\"/\"kube-root-ca.crt\"" Jul 01 17:24:09.796449 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.796341 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-md8rj\"/\"default-dockercfg-bqpdz\"" Jul 01 17:24:09.806208 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.806182 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-md8rj/must-gather-p5552"] Jul 01 17:24:09.878391 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.878356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-must-gather-output\") pod \"must-gather-p5552\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:09.878563 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.878410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v6pd\" (UniqueName: \"kubernetes.io/projected/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-kube-api-access-8v6pd\") pod \"must-gather-p5552\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:09.979379 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.979344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v6pd\" (UniqueName: \"kubernetes.io/projected/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-kube-api-access-8v6pd\") pod \"must-gather-p5552\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:09.979568 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.979417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-must-gather-output\") pod \"must-gather-p5552\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:09.979778 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.979755 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-must-gather-output\") pod \"must-gather-p5552\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:09.987202 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:09.987172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v6pd\" (UniqueName: \"kubernetes.io/projected/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-kube-api-access-8v6pd\") pod \"must-gather-p5552\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:10.114002 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:10.113893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:10.244761 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:10.244736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-md8rj/must-gather-p5552"] Jul 01 17:24:10.247561 ip-10-0-140-96 kubenswrapper[2577]: W0701 17:24:10.247534 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40f1e3c1_8e7a_4b2e_a86c_39a78d693c1c.slice/crio-9a88b1b7e998b70bd8089bd1d1967fd150682c90d3b5ee40ef15c59f2aa07e46 WatchSource:0}: Error finding container 9a88b1b7e998b70bd8089bd1d1967fd150682c90d3b5ee40ef15c59f2aa07e46: Status 404 returned error can't find the container with id 9a88b1b7e998b70bd8089bd1d1967fd150682c90d3b5ee40ef15c59f2aa07e46 Jul 01 17:24:10.249472 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:10.249450 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:24:10.406812 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:10.406722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-md8rj/must-gather-p5552" event={"ID":"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c","Type":"ContainerStarted","Data":"9a88b1b7e998b70bd8089bd1d1967fd150682c90d3b5ee40ef15c59f2aa07e46"} Jul 01 17:24:18.447837 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:18.447805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-md8rj/must-gather-p5552" event={"ID":"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c","Type":"ContainerStarted","Data":"bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada"} Jul 01 17:24:18.447837 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:18.447845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-md8rj/must-gather-p5552" event={"ID":"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c","Type":"ContainerStarted","Data":"802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66"} Jul 01 17:24:18.468665 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:18.468601 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-md8rj/must-gather-p5552" podStartSLOduration=2.339560647 podStartE2EDuration="9.46858422s" totalImagesPullingTime="7.129023573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:24:18.467571095 +0000 UTC m=+1564.002861521" watchObservedRunningTime="2026-07-01 17:24:18.46858422 +0000 UTC m=+1564.003874644" Jul 01 17:24:39.544604 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:39.544570 2577 generic.go:356] "Generic (PLEG): container finished" podID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerID="802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66" exitCode=0 Jul 01 17:24:39.545107 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:39.544642 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-md8rj/must-gather-p5552" event={"ID":"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c","Type":"ContainerDied","Data":"802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66"} Jul 01 17:24:39.545107 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:39.545015 2577 scope.go:117] "RemoveContainer" containerID="802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66" Jul 01 17:24:39.797729 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:39.797637 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-md8rj_must-gather-p5552_40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c/gather/0.log" Jul 01 17:24:43.715036 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:43.715000 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-26c5b_4060cbc2-f1bf-4fa0-b86b-feb2f9d2809a/global-pull-secret-syncer/0.log" Jul 01 17:24:43.973836 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:43.973745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nmzfr_98bebf84-ada9-4d90-b385-f95c02c8a683/konnectivity-agent/0.log" Jul 01 17:24:44.027975 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:44.027932 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-96.ec2.internal_46679bc7f7ce1d9afc659dfd5f23d201/haproxy/0.log" Jul 01 17:24:45.196205 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.196170 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-md8rj/must-gather-p5552"] Jul 01 17:24:45.196613 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.196350 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-md8rj/must-gather-p5552" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="copy" containerID="cri-o://bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada" gracePeriod=2 Jul 01 17:24:45.199105 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:24:45.199070 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p5552\" is forbidden: User \"system:node:ip-10-0-140-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-md8rj\": no relationship found between node 'ip-10-0-140-96.ec2.internal' and this object" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:45.201014 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.200986 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-md8rj/must-gather-p5552"] Jul 01 17:24:45.428710 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.428685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-md8rj_must-gather-p5552_40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c/copy/0.log" Jul 01 17:24:45.430275 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.430258 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:45.432330 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:24:45.432304 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p5552\" is forbidden: User \"system:node:ip-10-0-140-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-md8rj\": no relationship found between node 'ip-10-0-140-96.ec2.internal' and this object" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:45.570997 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.570908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-md8rj_must-gather-p5552_40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c/copy/0.log" Jul 01 17:24:45.571275 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.571249 2577 generic.go:356] "Generic (PLEG): container finished" podID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerID="bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada" exitCode=143 Jul 01 17:24:45.571388 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.571295 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:45.571388 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.571302 2577 scope.go:117] "RemoveContainer" containerID="bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada" Jul 01 17:24:45.573535 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:24:45.573511 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p5552\" is forbidden: User \"system:node:ip-10-0-140-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-md8rj\": no relationship found between node 'ip-10-0-140-96.ec2.internal' and this object" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:45.578903 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.578867 2577 scope.go:117] "RemoveContainer" containerID="802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66" Jul 01 17:24:45.591281 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.591264 2577 scope.go:117] "RemoveContainer" containerID="bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada" Jul 01 17:24:45.591542 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:24:45.591525 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada\": container with ID starting with bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada not found: ID does not exist" containerID="bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada" Jul 01 17:24:45.591590 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.591551 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada"} err="failed to get container status \"bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada\": rpc error: code = NotFound desc = could not find container \"bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada\": container with ID starting with bd0123f5df9d2f51c3e9db2d42a636c05006af068429e7de2e8645c01269bada not found: ID does not exist" Jul 01 17:24:45.591590 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.591570 2577 scope.go:117] "RemoveContainer" containerID="802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66" Jul 01 17:24:45.591798 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:24:45.591781 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66\": container with ID starting with 802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66 not found: ID does not exist" containerID="802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66" Jul 01 17:24:45.591839 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.591803 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66"} err="failed to get container status \"802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66\": rpc error: code = NotFound desc = could not find container \"802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66\": container with ID starting with 802a8c8033e32a173247e51f5b870ab0c76e52a655dff83bf508cf128ceb7a66 not found: ID does not exist" Jul 01 17:24:45.606133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.606107 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-must-gather-output\") pod \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " Jul 01 17:24:45.606232 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.606160 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v6pd\" (UniqueName: \"kubernetes.io/projected/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-kube-api-access-8v6pd\") pod \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\" (UID: \"40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c\") " Jul 01 17:24:45.607448 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.607424 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" (UID: "40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:24:45.608283 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.608263 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-kube-api-access-8v6pd" (OuterVolumeSpecName: "kube-api-access-8v6pd") pod "40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" (UID: "40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c"). InnerVolumeSpecName "kube-api-access-8v6pd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:24:45.707488 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.707445 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-must-gather-output\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:24:45.707488 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:45.707482 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v6pd\" (UniqueName: \"kubernetes.io/projected/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c-kube-api-access-8v6pd\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\"" Jul 01 17:24:45.881766 ip-10-0-140-96 kubenswrapper[2577]: E0701 17:24:45.881733 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p5552\" is forbidden: User \"system:node:ip-10-0-140-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-md8rj\": no relationship found between node 'ip-10-0-140-96.ec2.internal' and this object" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" pod="openshift-must-gather-md8rj/must-gather-p5552" Jul 01 17:24:46.909069 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:46.909029 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" path="/var/lib/kubelet/pods/40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c/volumes" Jul 01 17:24:47.836867 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.836840 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/alertmanager/0.log" Jul 01 17:24:47.862676 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.862652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/config-reloader/0.log" Jul 01 17:24:47.886926 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.886897 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/kube-rbac-proxy-web/0.log" Jul 01 17:24:47.915208 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.915180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/kube-rbac-proxy/0.log" Jul 01 17:24:47.943899 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.943873 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/kube-rbac-proxy-metric/0.log" Jul 01 17:24:47.969260 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.969231 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/prom-label-proxy/0.log" Jul 01 17:24:47.994726 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:47.994692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ef83c02-4229-4141-9ec4-8e90aa3cd11f/init-config-reloader/0.log" Jul 01 17:24:48.073733 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.073706 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-585rl_0807c53d-f094-40bb-b29d-525d5e4470e8/kube-state-metrics/0.log" Jul 01 17:24:48.095286 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.095178 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-585rl_0807c53d-f094-40bb-b29d-525d5e4470e8/kube-rbac-proxy-main/0.log" Jul 01 17:24:48.117763 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.117733 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-585rl_0807c53d-f094-40bb-b29d-525d5e4470e8/kube-rbac-proxy-self/0.log" Jul 01 17:24:48.181941 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.181913 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-wgzd7_8e08b0d6-db97-405d-b95b-dad1b909afa2/monitoring-plugin/0.log" Jul 01 17:24:48.328695 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.328664 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bw99k_47d241e6-d773-41ae-8157-69c5837339d7/node-exporter/0.log" Jul 01 17:24:48.351153 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.351059 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bw99k_47d241e6-d773-41ae-8157-69c5837339d7/kube-rbac-proxy/0.log" Jul 01 17:24:48.379346 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.379324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bw99k_47d241e6-d773-41ae-8157-69c5837339d7/init-textfile/0.log" Jul 01 17:24:48.493708 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.493677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zrv86_aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c/kube-rbac-proxy-main/0.log" Jul 01 17:24:48.521104 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.521068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zrv86_aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c/kube-rbac-proxy-self/0.log" Jul 01 17:24:48.549768 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.549742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zrv86_aa11dcef-7bdd-4b4e-a0f5-ba9cc286be4c/openshift-state-metrics/0.log" Jul 01 17:24:48.592975 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.592911 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/prometheus/0.log" Jul 01 17:24:48.617728 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.617645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/config-reloader/0.log" Jul 01 17:24:48.643485 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.643450 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/thanos-sidecar/0.log" Jul 01 17:24:48.668520 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.668494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/kube-rbac-proxy-web/0.log" Jul 01 17:24:48.691631 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.691604 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/kube-rbac-proxy/0.log" Jul 01 17:24:48.713251 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.713225 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/kube-rbac-proxy-thanos/0.log" Jul 01 17:24:48.741213 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.741185 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e35d2c51-36dc-492b-a7f2-9f23d47e8713/init-config-reloader/0.log" Jul 01 17:24:48.852792 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:48.852765 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-2wl2f_8a98a131-321b-4bdb-a33d-3528d91bbf0b/prometheus-operator-admission-webhook/0.log" Jul 01 17:24:50.429381 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:50.429349 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-gpwhs_59b93481-8962-4420-8bd5-0d7ada24e8e8/networking-console-plugin/0.log" Jul 01 17:24:52.222162 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222130 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4"] Jul 01 17:24:52.222533 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222463 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="copy" Jul 01 17:24:52.222533 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222474 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="copy" Jul 01 17:24:52.222533 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222491 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="gather" Jul 01 17:24:52.222533 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222496 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="gather" Jul 01 17:24:52.222663 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222550 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="gather" Jul 01 17:24:52.222663 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.222559 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f1e3c1-8e7a-4b2e-a86c-39a78d693c1c" containerName="copy" Jul 01 17:24:52.226004 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.225983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.228393 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.228377 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-crfk4\"/\"default-dockercfg-s5btw\"" Jul 01 17:24:52.228486 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.228381 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-crfk4\"/\"openshift-service-ca.crt\"" Jul 01 17:24:52.229454 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.229436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-crfk4\"/\"kube-root-ca.crt\"" Jul 01 17:24:52.235192 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.235168 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4"] Jul 01 17:24:52.366268 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.366231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5kl\" (UniqueName: \"kubernetes.io/projected/047a7e40-31db-494b-b408-a1cb3b197ff2-kube-api-access-6g5kl\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.366268 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.366272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-podres\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.366494 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.366301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-sys\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.366494 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.366409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-proc\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.366657 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.366496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-lib-modules\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.467937 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.467900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-proc\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.467976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-lib-modules\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5kl\" (UniqueName: \"kubernetes.io/projected/047a7e40-31db-494b-b408-a1cb3b197ff2-kube-api-access-6g5kl\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-podres\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-proc\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468133 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-sys\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468306 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-sys\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468306 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-lib-modules\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.468306 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.468162 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/047a7e40-31db-494b-b408-a1cb3b197ff2-podres\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.478205 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.478139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5kl\" (UniqueName: \"kubernetes.io/projected/047a7e40-31db-494b-b408-a1cb3b197ff2-kube-api-access-6g5kl\") pod \"perf-node-gather-daemonset-d4kc4\" (UID: \"047a7e40-31db-494b-b408-a1cb3b197ff2\") " pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.535809 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.535771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:52.701413 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.701342 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4"] Jul 01 17:24:52.970186 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.970159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gl52_ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa/dns/0.log" Jul 01 17:24:52.995153 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:52.995045 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gl52_ab2d2356-f8a8-4880-a96b-d63fbfbcf0fa/kube-rbac-proxy/0.log" Jul 01 17:24:53.169290 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.169260 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jtdkf_ae6e244c-2600-44bd-ba30-7550176e8a53/dns-node-resolver/0.log" Jul 01 17:24:53.612866 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.612834 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" event={"ID":"047a7e40-31db-494b-b408-a1cb3b197ff2","Type":"ContainerStarted","Data":"24396f3c8deb10ae55a889e3dd4ea8bffbdb98ff1a84fb7bd2742dbebba6f3a1"} Jul 01 17:24:53.613295 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.612884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" event={"ID":"047a7e40-31db-494b-b408-a1cb3b197ff2","Type":"ContainerStarted","Data":"e2d79678ac0062e385407077d66096021efb68ec0bd747c1a5048885e71e88e7"} Jul 01 17:24:53.613295 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.612994 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:24:53.634646 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.634589 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" podStartSLOduration=1.634572072 podStartE2EDuration="1.634572072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:24:53.63399694 +0000 UTC m=+1599.169287386" watchObservedRunningTime="2026-07-01 17:24:53.634572072 +0000 UTC m=+1599.169862496" Jul 01 17:24:53.749131 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.749096 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d4c5d7d76-f6q4h_2f38967f-a74f-4987-8ed1-fdb25fa05b6f/registry/0.log" Jul 01 17:24:53.856679 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:53.856651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsnqw_e2d1da7a-f169-4354-906a-a3d825d1c2f5/node-ca/0.log" Jul 01 17:24:55.089794 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:55.089770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6pv6w_90e7ad64-cc0f-4dff-b921-0101a0f158a7/serve-healthcheck-canary/0.log" Jul 01 17:24:55.526864 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:55.526830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-m6kh4_baf63312-fea9-4a55-a3bf-05cf6b3ae7c2/insights-operator/0.log" Jul 01 17:24:55.529470 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:55.529448 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-m6kh4_baf63312-fea9-4a55-a3bf-05cf6b3ae7c2/insights-operator/1.log" Jul 01 17:24:55.743161 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:55.743119 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvj4l_f7ea4666-cbf9-4613-aa0b-0014d666bf8d/kube-rbac-proxy/0.log" Jul 01 17:24:55.767766 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:55.767729 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvj4l_f7ea4666-cbf9-4613-aa0b-0014d666bf8d/exporter/0.log" Jul 01 17:24:55.792892 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:55.792797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvj4l_f7ea4666-cbf9-4613-aa0b-0014d666bf8d/extractor/0.log" Jul 01 17:24:58.070304 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:58.070279 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-frwv8_9cf1302b-923d-4b74-9e63-fe62f4e96f12/s3-init/0.log" Jul 01 17:24:58.086701 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:58.086677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-frwv8_9cf1302b-923d-4b74-9e63-fe62f4e96f12/download-hf-model/0.log" Jul 01 17:24:59.626908 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:24:59.626873 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-crfk4/perf-node-gather-daemonset-d4kc4" Jul 01 17:25:02.344634 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:02.344602 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-jtckm_97b30a31-5d14-47fc-a0fb-5fab81bb1df2/migrator/0.log" Jul 01 17:25:02.368234 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:02.368210 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-jtckm_97b30a31-5d14-47fc-a0fb-5fab81bb1df2/graceful-termination/0.log" Jul 01 17:25:02.747412 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:02.747381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-jn2xc_b4e6878a-f353-4b28-9c7e-ad8703f72694/kube-storage-version-migrator-operator/1.log" Jul 01 17:25:02.749022 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:02.748994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-jn2xc_b4e6878a-f353-4b28-9c7e-ad8703f72694/kube-storage-version-migrator-operator/0.log" Jul 01 17:25:03.725862 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:03.725833 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9k7tj_c882f671-340a-49e9-86d2-9bb0d8c75658/kube-multus/0.log" Jul 01 17:25:04.110031 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.110005 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/kube-multus-additional-cni-plugins/0.log" Jul 01 17:25:04.134721 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.134694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/egress-router-binary-copy/0.log" Jul 01 17:25:04.161169 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.161140 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/cni-plugins/0.log" Jul 01 17:25:04.187008 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.186977 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/bond-cni-plugin/0.log" Jul 01 17:25:04.216938 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.216897 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/routeoverride-cni/0.log" Jul 01 17:25:04.239638 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.239610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/whereabouts-cni-bincopy/0.log" Jul 01 17:25:04.261726 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.261694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpf8t_ba50a4c5-bdd8-4295-8285-999519a9e53e/whereabouts-cni/0.log" Jul 01 17:25:04.417755 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.417675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mcrjd_12b2765d-53b9-4f4a-b4e6-88bd94cde305/network-metrics-daemon/0.log" Jul 01 17:25:04.438554 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:04.438528 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mcrjd_12b2765d-53b9-4f4a-b4e6-88bd94cde305/kube-rbac-proxy/0.log" Jul 01 17:25:05.712856 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.712825 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-controller/0.log" Jul 01 17:25:05.733235 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.733203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/1.log" Jul 01 17:25:05.733392 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.733209 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovn-acl-logging/0.log" Jul 01 17:25:05.755590 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.755509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/kube-rbac-proxy-node/0.log" Jul 01 17:25:05.780201 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.780173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 17:25:05.799932 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.799909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/northd/0.log" Jul 01 17:25:05.821704 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.821676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/nbdb/0.log" Jul 01 17:25:05.845029 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.845002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/sbdb/0.log" Jul 01 17:25:05.905239 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:05.905211 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9pvd_1b2cc6f1-3492-4dcc-9bae-1fe6edcd0277/ovnkube-controller/0.log" Jul 01 17:25:06.968607 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:06.968572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wxxg6_86bc2c27-afb4-40f9-af3c-9fe2d4a01837/network-check-target-container/0.log" Jul 01 17:25:08.029829 ip-10-0-140-96 kubenswrapper[2577]: I0701 17:25:08.029798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9bxrr_24a154ab-5f3e-4124-99ad-8c63f1c5c31f/iptables-alerter/0.log"