Jul 09 18:04:59.222711 ip-10-0-138-186 systemd[1]: Starting Kubernetes Kubelet... Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.631804 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636653 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636666 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636670 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636673 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636676 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636683 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636686 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:04:59.642103 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636689 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636693 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636696 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636699 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636702 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636705 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636708 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636711 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636713 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636716 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636718 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636721 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636723 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636726 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636728 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636732 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636734 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636736 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636739 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636741 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:04:59.643147 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636744 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636746 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636749 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636751 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636754 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636756 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636759 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636761 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636763 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636766 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636770 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636773 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636775 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636777 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636781 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636784 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636787 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636790 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636792 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636795 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:04:59.644209 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636797 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636800 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636802 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636805 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636807 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636810 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636812 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636815 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636817 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636820 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636822 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636825 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636827 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636832 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636836 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636839 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636842 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636845 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636848 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:04:59.644881 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636850 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636853 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636855 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636858 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636861 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636863 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636866 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636868 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636873 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636877 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636880 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636883 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636886 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636888 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636891 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636894 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636897 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636901 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636904 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:04:59.645936 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636907 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636911 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636914 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636917 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636920 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636923 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636925 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636928 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636930 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636933 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636936 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636939 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636941 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.636944 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637746 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637754 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637756 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637759 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637768 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637771 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:04:59.646593 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637773 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637776 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637780 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637782 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637785 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637788 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637790 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637793 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637795 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637798 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637800 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637803 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637806 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637808 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637811 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637814 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637816 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637819 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637821 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637825 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:04:59.647665 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637827 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637831 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637833 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637836 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637838 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637841 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637844 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637846 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637849 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637853 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637857 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637865 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637869 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637871 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637874 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637878 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637881 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637884 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637886 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637889 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:04:59.648319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637892 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637894 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637897 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637900 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637903 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637906 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637908 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637911 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637914 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637916 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637919 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637921 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637924 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637929 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637932 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637935 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637937 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637940 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637944 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:04:59.649189 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637947 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637949 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637952 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637954 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637956 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637965 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637967 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637970 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637972 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637975 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637978 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637980 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637983 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637985 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637988 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637990 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637993 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637995 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.637998 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638001 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:04:59.649820 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638004 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638007 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638009 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638012 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638015 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638017 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638021 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638024 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638026 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638029 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638031 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638035 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638039 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638042 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638488 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638494 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638498 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638509 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638513 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:04:59.650913 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638516 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638519 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638522 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638524 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638527 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638529 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638532 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638535 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638537 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638540 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638543 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638546 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638548 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638551 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638554 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638556 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638559 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638561 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638564 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:04:59.651765 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638568 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638571 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638573 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638576 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638579 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638581 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638583 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638586 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638588 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638591 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638593 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638596 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638599 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638602 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638605 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638607 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638610 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638612 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638615 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638617 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:04:59.652839 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638621 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638624 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638627 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638630 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638633 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638635 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638638 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638640 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638642 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638645 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638648 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638650 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638654 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638657 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638660 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638662 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638665 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638668 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638671 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638673 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:04:59.653479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638676 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638680 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638683 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638685 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638688 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638691 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638694 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638696 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638699 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638701 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638704 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638706 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638709 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638711 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638714 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638716 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638719 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638723 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638725 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638729 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:04:59.654134 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638732 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638735 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638737 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638740 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638743 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638746 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638748 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638751 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638753 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638756 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638759 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638761 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638764 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638766 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.638769 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638836 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638846 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638858 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638876 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638880 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638884 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 18:04:59.654779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638887 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638891 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638894 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638897 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638901 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638904 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638907 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638910 2573 flags.go:64] FLAG: --cgroup-root="" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638914 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638917 2573 flags.go:64] FLAG: --client-ca-file="" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638920 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638923 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638930 2573 flags.go:64] FLAG: --cluster-domain="" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638932 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638936 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638940 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638944 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638948 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638950 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638953 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638957 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638960 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638963 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638966 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 18:04:59.655420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638969 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638972 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638976 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638979 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638982 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638984 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638988 2573 flags.go:64] FLAG: --enable-server="true" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638991 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638995 2573 flags.go:64] FLAG: --event-burst="100" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.638998 2573 flags.go:64] FLAG: --event-qps="50" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639001 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639004 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639007 2573 flags.go:64] FLAG: --eviction-hard="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639010 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639013 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639016 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639020 2573 flags.go:64] FLAG: --eviction-soft="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639023 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639026 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639029 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639032 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639035 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639037 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639042 2573 flags.go:64] FLAG: --feature-gates="" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639046 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 18:04:59.656282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639049 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639052 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639055 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639058 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639061 2573 flags.go:64] FLAG: --help="false" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639064 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-138-186.ec2.internal" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639067 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639070 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639073 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639076 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639080 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639083 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639086 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639088 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639092 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639095 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639098 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639100 2573 flags.go:64] FLAG: --kube-reserved="" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639103 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639106 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639109 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639112 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639115 2573 flags.go:64] FLAG: --lock-file="" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639120 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 18:04:59.657160 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639123 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639126 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639131 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639134 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639137 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639139 2573 flags.go:64] FLAG: --logging-format="text" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639144 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639147 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639150 2573 flags.go:64] FLAG: --manifest-url="" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639153 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639157 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639160 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639166 2573 flags.go:64] FLAG: --max-pods="110" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639169 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639172 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639175 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639178 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639181 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639184 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639187 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639193 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639196 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639199 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 18:04:59.657994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639203 2573 flags.go:64] FLAG: --pod-cidr="" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639206 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639212 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639215 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639218 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639221 2573 flags.go:64] FLAG: --port="10250" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639224 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639227 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00d263abcead75aba" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639231 2573 flags.go:64] FLAG: --qos-reserved="" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639234 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639237 2573 flags.go:64] FLAG: --register-node="true" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639240 2573 flags.go:64] FLAG: --register-with-taints="" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639244 2573 flags.go:64] FLAG: --registry-burst="10" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639247 2573 flags.go:64] FLAG: --registry-qps="5" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639250 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639252 2573 flags.go:64] FLAG: --reserved-memory="" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639258 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639261 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639264 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639267 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639270 2573 flags.go:64] FLAG: --runonce="false" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639273 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639276 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639279 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639282 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 18:04:59.659191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639285 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639288 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639291 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639294 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639296 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639299 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639302 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639305 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639309 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639312 2573 flags.go:64] FLAG: --system-cgroups="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639315 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639321 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639323 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639326 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639330 2573 flags.go:64] FLAG: --tls-min-version="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639335 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639338 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639340 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639343 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639346 2573 flags.go:64] FLAG: --v="2" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639350 2573 flags.go:64] FLAG: --version="false" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639354 2573 flags.go:64] FLAG: --vmodule="" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639357 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.639362 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 18:04:59.659945 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639512 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639517 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639521 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639524 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639528 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639532 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639535 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639538 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639541 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639543 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639546 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639549 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639553 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639556 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639559 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639561 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639564 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639567 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639570 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:04:59.660619 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639573 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639575 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639578 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639580 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639584 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639587 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639589 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639592 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639594 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639597 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639599 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639602 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639607 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639609 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639612 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639615 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639617 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639620 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639622 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639626 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:04:59.661188 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639629 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639632 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639635 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639638 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639640 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639643 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639646 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639649 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639651 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639654 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639656 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639659 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639662 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639664 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639667 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639669 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639673 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639676 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639678 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639681 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:04:59.661764 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639683 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639686 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639689 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639691 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639695 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639697 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639700 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639702 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639705 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639707 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639710 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639713 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639715 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639718 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639720 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639722 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639725 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639727 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639730 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639732 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:04:59.662319 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639735 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639738 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639740 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639743 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639746 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639748 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639751 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639753 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639757 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639760 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639762 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639765 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639767 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639770 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639772 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639775 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639778 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639781 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639783 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:04:59.663012 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.639786 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.640646 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.660542 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.660558 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.661555 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.661570 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661631 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661636 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661639 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661642 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661645 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661648 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661650 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661653 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661656 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:04:59.663558 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661659 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661662 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661664 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661667 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661670 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661673 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661677 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661680 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661683 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661686 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661689 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661692 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661695 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661697 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661701 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661704 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661706 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661709 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661712 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:04:59.664034 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661715 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661718 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661720 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661723 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661725 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661728 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661731 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661734 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661736 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661739 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661742 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661745 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661747 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661750 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661752 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661755 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661757 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661760 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661763 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661766 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:04:59.664583 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661769 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661771 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661774 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661777 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661780 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661783 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661786 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661789 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661792 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661796 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661800 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661803 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661806 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661809 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661812 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661814 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661817 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661820 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661823 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:04:59.665123 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661825 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661828 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661830 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661833 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661835 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661838 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661841 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661843 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661846 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661850 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661852 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661855 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661858 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661861 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661864 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661866 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661869 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661872 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661874 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661877 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:04:59.665680 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661880 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661882 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661885 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661887 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661890 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661893 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661897 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661901 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661904 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661907 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661910 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.661913 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.661918 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662032 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662037 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:04:59.755924 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662041 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:04:59.717636 ip-10-0-138-186 systemd[1]: Started Kubernetes Kubelet. Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662044 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662047 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662050 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662053 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662056 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662059 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662062 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662065 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662068 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662072 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662075 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662078 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662081 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662083 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662086 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662089 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662092 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662095 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662097 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:04:59.757131 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662100 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662102 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662105 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662108 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662111 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662113 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662116 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662119 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662121 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662124 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662127 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662130 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662133 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662135 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662138 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662140 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662142 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662145 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662147 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662150 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:04:59.758215 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662153 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662155 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662158 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662161 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662163 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662166 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662169 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662171 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662174 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662176 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662178 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662181 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662184 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662186 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662190 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662192 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662195 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662197 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662200 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662203 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:04:59.759125 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662205 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662209 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662213 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662216 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662219 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662221 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662224 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662227 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662229 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662233 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662237 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662239 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662243 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662247 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662251 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662254 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662257 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662260 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662262 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:04:59.759965 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662265 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662268 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662270 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662272 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662275 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662277 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662280 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662283 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662286 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662289 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662291 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662294 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662296 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662299 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662301 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662304 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662307 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:04:59.760801 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:04:59.662309 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.662315 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.662423 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.664719 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.666068 2573 server.go:1019] "Starting client certificate rotation" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.666166 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.666203 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.668472 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.670659 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.681615 2573 log.go:25] "Validated CRI v1 runtime API" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.683568 2573 log.go:25] "Validated CRI v1 image API" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.684267 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 18:04:59.762187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.687561 2573 fs.go:135] Filesystem UUIDs: map[103fc052-2543-4f0a-960f-6f34c695a238:/dev/nvme0n1p3 14949114-31b8-4111-be93-5c8a51f099f5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 18:04:59.762882 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.687583 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.696296 2573 manager.go:216] Machine: {Timestamp:2026-07-09 18:04:59.694800491 +0000 UTC m=+0.343955152 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098650 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec265213a501157ed4d7144144524b80 SystemUUID:ec265213-a501-157e-d4d7-144144524b80 BootID:43c6a158-74ae-4c82-9ad8-1de88e5c647c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:9f:de:17:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:9f:de:17:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:16:ad:ae:b3:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.696437 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.696561 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.700336 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.700363 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.700901 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 18:04:59.764328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.701114 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.701126 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.701133 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.701838 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.703049 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706207 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706321 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706350 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706364 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706375 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706386 2573 kubelet.go:398] "Adding apiserver pod source" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706394 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706841 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.706862 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.709027 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.710862 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.710889 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711028 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711040 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711046 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711052 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711060 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711065 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711581 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711587 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711595 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711600 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711609 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.711616 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.713019 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.713032 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.715525 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.715553 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.715582 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.716630 2573 server.go:1268] "Started kubelet" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.716709 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.716752 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.716801 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.718075 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.719838 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 09 18:04:59.764815 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.720892 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c24w9" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.724870 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.724874 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.724988 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.725622 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.725636 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.725707 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.725782 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.725790 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727152 2573 factory.go:55] Registering systemd factory Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727169 2573 factory.go:223] Registration of the systemd container factory successfully Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727414 2573 factory.go:153] Registering CRI-O factory Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727430 2573 factory.go:223] Registration of the crio container factory successfully Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727484 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727515 2573 factory.go:103] Registering Raw factory Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.727556 2573 manager.go:1196] Started watching for new ooms in manager Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.728263 2573 manager.go:349] Starting recovery of all containers Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.728464 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c24w9" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.728872 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.728967 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.729067 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-186.ec2.internal.18c0b1366ac8a916 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-186.ec2.internal,UID:ip-10-0-138-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-186.ec2.internal,},FirstTimestamp:2026-07-09 18:04:59.716602134 +0000 UTC m=+0.365756775,LastTimestamp:2026-07-09 18:04:59.716602134 +0000 UTC m=+0.365756775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-186.ec2.internal,}" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.730832 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.748476 2573 manager.go:354] Recovery completed Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.752934 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.755363 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.755388 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.755403 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.756047 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.756058 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.756078 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.756388 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.757111 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:04:59.767047 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.757134 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:04:59.768318 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.757149 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:04:59.768318 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.757607 2573 policy_none.go:49] "None policy: Start" Jul 09 18:04:59.768318 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.757633 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 18:04:59.768318 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.757647 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 18:04:59.768318 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.758763 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-186.ec2.internal.18c0b1366d1852b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-186.ec2.internal,UID:ip-10-0-138-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-186.ec2.internal,},FirstTimestamp:2026-07-09 18:04:59.755377333 +0000 UTC m=+0.404531979,LastTimestamp:2026-07-09 18:04:59.755377333 +0000 UTC m=+0.404531979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-186.ec2.internal,}" Jul 09 18:04:59.768318 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.758941 2573 policy_none.go:47] "Start" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822189 2573 manager.go:337] "Starting Device Plugin manager" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.822245 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822259 2573 server.go:87] "Starting device plugin registration server" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822554 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822568 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822685 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822777 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.822786 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.823374 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 18:04:59.905556 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.823419 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.923584 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.924817 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.924847 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.924861 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.924894 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.933769 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.933790 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-186.ec2.internal\": node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.953368 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.996700 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.998134 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.998173 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:04:59.998196 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:04:59.998233 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.000928 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:05:00.090896 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.054570 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.101244 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal"] Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.101353 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.102401 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.102430 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.102441 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.104008 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.104135 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.104165 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.104811 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.104851 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.104865 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.105607 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.105634 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.105645 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.106670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.106701 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.107418 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.107445 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.107470 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.128551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbc50c4153caf2739fb4e20e06dc6519-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"cbc50c4153caf2739fb4e20e06dc6519\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.128577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc50c4153caf2739fb4e20e06dc6519-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"cbc50c4153caf2739fb4e20e06dc6519\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.128597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a99e495f424a8870814d989f4c4e9e7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-186.ec2.internal\" (UID: \"3a99e495f424a8870814d989f4c4e9e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.129106 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-186.ec2.internal\" not found" node="ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.133418 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-186.ec2.internal\" not found" node="ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.226518 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.155147 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.229535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.229272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbc50c4153caf2739fb4e20e06dc6519-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"cbc50c4153caf2739fb4e20e06dc6519\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.229535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.229310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc50c4153caf2739fb4e20e06dc6519-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"cbc50c4153caf2739fb4e20e06dc6519\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.229535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.229332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a99e495f424a8870814d989f4c4e9e7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-186.ec2.internal\" (UID: \"3a99e495f424a8870814d989f4c4e9e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.229535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.229383 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a99e495f424a8870814d989f4c4e9e7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-186.ec2.internal\" (UID: \"3a99e495f424a8870814d989f4c4e9e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.229535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.229385 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbc50c4153caf2739fb4e20e06dc6519-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"cbc50c4153caf2739fb4e20e06dc6519\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.229535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.229400 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc50c4153caf2739fb4e20e06dc6519-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"cbc50c4153caf2739fb4e20e06dc6519\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.356174 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.255928 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.357605 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.357513 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.480994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.431360 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.480994 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.437150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" Jul 09 18:05:00.480994 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.457764 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.558941 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.558900 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.635254 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.635224 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:05:00.659462 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.659421 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.666109 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.666079 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 18:05:00.666279 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.666259 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 18:05:00.666316 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.666281 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 18:05:00.732586 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.732512 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:00:00 +0000 UTC" deadline="2028-04-20 07:04:26.059590582 +0000 UTC" Jul 09 18:05:00.732586 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.732548 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15612h59m25.327046434s" Jul 09 18:05:00.760550 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.760509 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.796833 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.796803 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:05:00.820780 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.820744 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:05:00.821956 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.821940 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:05:00.822045 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.821972 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:05:00.822045 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:00.821983 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:05:00.861554 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.861519 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:00.962659 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:00.962618 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:01.063197 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.063120 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:01.083126 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:01.083094 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a99e495f424a8870814d989f4c4e9e7.slice/crio-9ae40719ae1429ee85c5b2d59ee287f44ea243184dc2ae64870a48fb7c3596c6 WatchSource:0}: Error finding container 9ae40719ae1429ee85c5b2d59ee287f44ea243184dc2ae64870a48fb7c3596c6: Status 404 returned error can't find the container with id 9ae40719ae1429ee85c5b2d59ee287f44ea243184dc2ae64870a48fb7c3596c6 Jul 09 18:05:01.089672 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.089656 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 18:05:01.124483 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:01.124455 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc50c4153caf2739fb4e20e06dc6519.slice/crio-28e556ae15eb99618ae9189f2428bc9c02e1a94e300983b5a69cc2577fc7e51d WatchSource:0}: Error finding container 28e556ae15eb99618ae9189f2428bc9c02e1a94e300983b5a69cc2577fc7e51d: Status 404 returned error can't find the container with id 28e556ae15eb99618ae9189f2428bc9c02e1a94e300983b5a69cc2577fc7e51d Jul 09 18:05:01.164593 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.164543 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" Jul 09 18:05:01.206233 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.206209 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:05:01.225864 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.225829 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" Jul 09 18:05:01.240952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.240929 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 18:05:01.242159 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.242144 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" Jul 09 18:05:01.249654 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.249637 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 18:05:01.709760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.709728 2573 apiserver.go:52] "Watching apiserver" Jul 09 18:05:01.716825 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.716806 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 18:05:01.717191 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.717167 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-86drl","openshift-image-registry/node-ca-xgr7h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-zbnmz","openshift-multus/network-metrics-daemon-7qkqj","openshift-network-diagnostics/network-check-target-p2j48","openshift-network-operator/iptables-alerter-bt5tf","openshift-ovn-kubernetes/ovnkube-node-s7s8z","kube-system/global-pull-secret-syncer-hz6fn","kube-system/konnectivity-agent-7d6t2","kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6","openshift-cluster-node-tuning-operator/tuned-2f7hk","openshift-multus/multus-qqh66"] Jul 09 18:05:01.720221 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.720201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.722905 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.722876 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m6nhv\"" Jul 09 18:05:01.723029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.722933 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.723029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.722948 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 18:05:01.723029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.722890 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.723378 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.723354 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.725121 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.725107 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 18:05:01.725760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.725462 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rcf8h\"" Jul 09 18:05:01.725760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.725486 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.725760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.725542 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.725760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.725485 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.728147 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.728127 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 18:05:01.728404 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.728387 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 18:05:01.728470 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.728441 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.728675 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.728657 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8wvd8\"" Jul 09 18:05:01.728757 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.728741 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.729479 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.729083 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.730723 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.730705 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:01.730835 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.730781 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:01.731487 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.731466 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 18:05:01.731788 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.731734 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cgrlv\"" Jul 09 18:05:01.732030 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.732016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 18:05:01.732812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.732793 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:01.732893 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.732853 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:01.734916 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.734902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.734988 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.734960 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:01.736810 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.736790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.737489 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-socket-dir-parent\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.737574 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-multus-certs\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.737574 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-system-cni-dir\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.737658 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c4d13bc-0664-47b3-a939-36e068cc14f4-host-slash\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.737658 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737583 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 18:05:01.737658 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwhlj\" (UniqueName: \"kubernetes.io/projected/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-kube-api-access-cwhlj\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.737796 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cnibin\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.737796 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.737796 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.737930 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737813 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.737930 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-kubernetes\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.737930 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysctl-conf\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738042 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4533e635-e32d-47e1-acb9-66901d8ddec4-cni-binary-copy\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738042 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.737985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-kubelet\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738042 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-hostroot\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738156 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-os-release\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.738156 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-modprobe-d\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738156 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysctl-d\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738156 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-sys\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738156 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-lib-modules\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-k8s-cni-cncf-io\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-cni-multus\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq44p\" (UniqueName: \"kubernetes.io/projected/4533e635-e32d-47e1-acb9-66901d8ddec4-kube-api-access-vq44p\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-tmp\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-conf-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738336 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.738358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtcnc\" (UniqueName: \"kubernetes.io/projected/c3d712b2-606f-49cd-9ae8-ddfe017f732d-kube-api-access-wtcnc\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c4d13bc-0664-47b3-a939-36e068cc14f4-iptables-alerter-script\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738392 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w99hk\" (UniqueName: \"kubernetes.io/projected/7c4d13bc-0664-47b3-a939-36e068cc14f4-kube-api-access-w99hk\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysconfig\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-systemd\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-host\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-tuned\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-cnibin\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-netns\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738566 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-var-lib-kubelet\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-cni-bin\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-etc-kubernetes\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.738623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738619 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.739060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-daemon-config\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.739060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-run\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.739060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-system-cni-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.739060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-cni-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.739060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.738870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-os-release\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.739370 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.739353 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.739814 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.739800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.739911 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.739894 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-627cp\"" Jul 09 18:05:01.740052 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.740037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.740862 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.740835 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.740931 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.740843 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9hpzz\"" Jul 09 18:05:01.741152 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.741138 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 18:05:01.741210 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.741175 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.742289 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.742272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.742946 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.742889 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27n59\"" Jul 09 18:05:01.742946 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.742907 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 18:05:01.742946 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.742918 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 18:05:01.744266 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.744247 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.744734 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.744715 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 18:05:01.745083 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.745066 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.745083 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.745077 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 18:05:01.745215 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.745097 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.745215 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.745178 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 18:05:01.745326 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.745248 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tplfg\"" Jul 09 18:05:01.745629 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.745612 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 18:05:01.746817 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.746802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 18:05:01.746909 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.746807 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 18:05:01.747086 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.747071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 18:05:01.747207 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.747189 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6m5bb\"" Jul 09 18:05:01.767013 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.766992 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxgz7" Jul 09 18:05:01.777486 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.777465 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxgz7" Jul 09 18:05:01.826932 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.826907 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 18:05:01.839099 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-daemon-config\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.839198 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8dcaac-1020-4c71-8277-1779fe212d84-tmp-dir\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.839246 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2rfz\" (UniqueName: \"kubernetes.io/projected/8688453f-fca7-4ea0-8f02-d601b383693e-kube-api-access-w2rfz\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.839246 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-socket-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.839321 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cnibin\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839321 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839395 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839361 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cnibin\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839449 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:01.839449 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839440 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-multus-certs\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.839573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839504 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-multus-certs\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.839573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-system-cni-dir\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-node-log\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.839573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839568 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-system-cni-dir\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c4d13bc-0664-47b3-a939-36e068cc14f4-host-slash\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839605 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-daemon-config\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839656 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c4d13bc-0664-47b3-a939-36e068cc14f4-host-slash\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d5672ed-fabe-44ba-bc52-63ca5967df2c-konnectivity-ca\") pod \"konnectivity-agent-7d6t2\" (UID: \"9d5672ed-fabe-44ba-bc52-63ca5967df2c\") " pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-ovnkube-script-lib\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-kubernetes\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysctl-conf\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-os-release\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839779 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-kubernetes\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839781 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69e420c6-bf61-46ff-a147-9b5b653a237a-dbus\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839805 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3d712b2-606f-49cd-9ae8-ddfe017f732d-os-release\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.839879 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f289\" (UniqueName: \"kubernetes.io/projected/de8dcaac-1020-4c71-8277-1779fe212d84-kube-api-access-2f289\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839836 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysctl-conf\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-systemd-units\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-etc-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-env-overrides\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysctl-d\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.839981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-sys\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-lib-modules\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840036 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysctl-d\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-k8s-cni-cncf-io\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-host\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840078 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-k8s-cni-cncf-io\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-cni-netd\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840096 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-sys\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.840548 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-tmp\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtcnc\" (UniqueName: \"kubernetes.io/projected/c3d712b2-606f-49cd-9ae8-ddfe017f732d-kube-api-access-wtcnc\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840140 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-slash\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840185 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-lib-modules\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c4d13bc-0664-47b3-a939-36e068cc14f4-iptables-alerter-script\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w99hk\" (UniqueName: \"kubernetes.io/projected/7c4d13bc-0664-47b3-a939-36e068cc14f4-kube-api-access-w99hk\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-cnibin\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-netns\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-log-socket\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-var-lib-kubelet\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840389 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-run-netns\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840398 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-cnibin\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840413 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840479 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-var-lib-kubelet\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-cni-bin\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8688453f-fca7-4ea0-8f02-d601b383693e-ovn-node-metrics-cert\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-ovn\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-registration-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840657 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-serviceca\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-run\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-system-cni-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-cni-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840769 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-system-cni-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.841720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-os-release\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840781 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-run\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840783 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c4d13bc-0664-47b3-a939-36e068cc14f4-iptables-alerter-script\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-socket-dir-parent\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840848 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-cni-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840853 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-os-release\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-ovnkube-config\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840873 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-socket-dir-parent\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwhlj\" (UniqueName: \"kubernetes.io/projected/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-kube-api-access-cwhlj\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-var-lib-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.840939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-device-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-sys-fs\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4533e635-e32d-47e1-acb9-66901d8ddec4-cni-binary-copy\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841065 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.842339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-kubelet\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841103 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-kubelet\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-hostroot\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69e420c6-bf61-46ff-a147-9b5b653a237a-kubelet-config\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d5672ed-fabe-44ba-bc52-63ca5967df2c-agent-certs\") pod \"konnectivity-agent-7d6t2\" (UID: \"9d5672ed-fabe-44ba-bc52-63ca5967df2c\") " pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-kubelet\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-run-netns\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841220 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-hostroot\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841253 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-modprobe-d\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-cni-multus\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq44p\" (UniqueName: \"kubernetes.io/projected/4533e635-e32d-47e1-acb9-66901d8ddec4-kube-api-access-vq44p\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841340 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-modprobe-d\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841357 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-cni-multus\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z69cm\" (UniqueName: \"kubernetes.io/projected/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-kube-api-access-z69cm\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.842777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nztgz\" (UniqueName: \"kubernetes.io/projected/c0a6c138-17a4-4284-b50c-655f558d88f1-kube-api-access-nztgz\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-conf-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841542 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4533e635-e32d-47e1-acb9-66901d8ddec4-cni-binary-copy\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysconfig\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-systemd\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841600 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-multus-conf-dir\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-host\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841668 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-host\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841674 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-sysconfig\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841668 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-systemd\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-tuned\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-cni-bin\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g22sc\" (UniqueName: \"kubernetes.io/projected/bc406faa-9889-40ca-8c35-9b70d78bc8ca-kube-api-access-g22sc\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de8dcaac-1020-4c71-8277-1779fe212d84-hosts-file\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-etc-kubernetes\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-systemd\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-etc-kubernetes\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.841871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4533e635-e32d-47e1-acb9-66901d8ddec4-host-var-lib-cni-bin\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.842097 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3d712b2-606f-49cd-9ae8-ddfe017f732d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.843816 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-tmp\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.843884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.843861 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-etc-tuned\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.851024 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.850974 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtcnc\" (UniqueName: \"kubernetes.io/projected/c3d712b2-606f-49cd-9ae8-ddfe017f732d-kube-api-access-wtcnc\") pod \"multus-additional-cni-plugins-zbnmz\" (UID: \"c3d712b2-606f-49cd-9ae8-ddfe017f732d\") " pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:01.851227 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.851208 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwhlj\" (UniqueName: \"kubernetes.io/projected/38338cd5-5bb7-4c99-8a1b-b22abf30b40c-kube-api-access-cwhlj\") pod \"tuned-2f7hk\" (UID: \"38338cd5-5bb7-4c99-8a1b-b22abf30b40c\") " pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:01.851623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.851602 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq44p\" (UniqueName: \"kubernetes.io/projected/4533e635-e32d-47e1-acb9-66901d8ddec4-kube-api-access-vq44p\") pod \"multus-qqh66\" (UID: \"4533e635-e32d-47e1-acb9-66901d8ddec4\") " pod="openshift-multus/multus-qqh66" Jul 09 18:05:01.851725 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.851603 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w99hk\" (UniqueName: \"kubernetes.io/projected/7c4d13bc-0664-47b3-a939-36e068cc14f4-kube-api-access-w99hk\") pod \"iptables-alerter-bt5tf\" (UID: \"7c4d13bc-0664-47b3-a939-36e068cc14f4\") " pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.942573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d5672ed-fabe-44ba-bc52-63ca5967df2c-konnectivity-ca\") pod \"konnectivity-agent-7d6t2\" (UID: \"9d5672ed-fabe-44ba-bc52-63ca5967df2c\") " pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.942632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-ovnkube-script-lib\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943567 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69e420c6-bf61-46ff-a147-9b5b653a237a-dbus\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f289\" (UniqueName: \"kubernetes.io/projected/de8dcaac-1020-4c71-8277-1779fe212d84-kube-api-access-2f289\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-systemd-units\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-etc-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-env-overrides\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-host\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-cni-netd\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-slash\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-log-socket\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.945901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.943975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-cni-bin\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8688453f-fca7-4ea0-8f02-d601b383693e-ovn-node-metrics-cert\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-ovn\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-registration-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944130 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-serviceca\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-ovnkube-config\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-var-lib-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-device-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-sys-fs\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944274 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-ovnkube-script-lib\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69e420c6-bf61-46ff-a147-9b5b653a237a-kubelet-config\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d5672ed-fabe-44ba-bc52-63ca5967df2c-agent-certs\") pod \"konnectivity-agent-7d6t2\" (UID: \"9d5672ed-fabe-44ba-bc52-63ca5967df2c\") " pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.946722 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944350 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-kubelet\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-run-netns\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z69cm\" (UniqueName: \"kubernetes.io/projected/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-kube-api-access-z69cm\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944475 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nztgz\" (UniqueName: \"kubernetes.io/projected/c0a6c138-17a4-4284-b50c-655f558d88f1-kube-api-access-nztgz\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g22sc\" (UniqueName: \"kubernetes.io/projected/bc406faa-9889-40ca-8c35-9b70d78bc8ca-kube-api-access-g22sc\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de8dcaac-1020-4c71-8277-1779fe212d84-hosts-file\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-systemd\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8dcaac-1020-4c71-8277-1779fe212d84-tmp-dir\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2rfz\" (UniqueName: \"kubernetes.io/projected/8688453f-fca7-4ea0-8f02-d601b383693e-kube-api-access-w2rfz\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-socket-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944830 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-systemd-units\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-node-log\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.947388 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.944898 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.944917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.945007 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:05:02.444960772 +0000 UTC m=+3.094115413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945024 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945075 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-etc-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.945283 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.945351 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:02.445335434 +0000 UTC m=+3.094490061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945431 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-cni-bin\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945440 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de8dcaac-1020-4c71-8277-1779fe212d84-hosts-file\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945499 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-systemd\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945573 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d5672ed-fabe-44ba-bc52-63ca5967df2c-konnectivity-ca\") pod \"konnectivity-agent-7d6t2\" (UID: \"9d5672ed-fabe-44ba-bc52-63ca5967df2c\") " pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945647 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945654 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945715 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-slash\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945722 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-host\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945736 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-registration-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945773 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-cni-netd\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945798 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-run-netns\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945804 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-var-lib-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945945 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-device-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945960 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-host-kubelet\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945981 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-socket-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946039 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-ovn\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.945888 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-ovnkube-config\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946184 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-sys-fs\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946260 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-log-socket\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946327 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0a6c138-17a4-4284-b50c-655f558d88f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946349 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69e420c6-bf61-46ff-a147-9b5b653a237a-dbus\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.948655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69e420c6-bf61-46ff-a147-9b5b653a237a-kubelet-config\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.946864 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8dcaac-1020-4c71-8277-1779fe212d84-tmp-dir\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.947655 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-node-log\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.947676 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-serviceca\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.947759 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8688453f-fca7-4ea0-8f02-d601b383693e-env-overrides\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.947748 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8688453f-fca7-4ea0-8f02-d601b383693e-run-openvswitch\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.948622 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8688453f-fca7-4ea0-8f02-d601b383693e-ovn-node-metrics-cert\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.949408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.949078 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d5672ed-fabe-44ba-bc52-63ca5967df2c-agent-certs\") pod \"konnectivity-agent-7d6t2\" (UID: \"9d5672ed-fabe-44ba-bc52-63ca5967df2c\") " pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:01.955988 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.955958 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:01.955988 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.955983 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:01.956165 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.955998 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:01.956165 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:01.956055 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:05:02.456041074 +0000 UTC m=+3.105195703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:01.958312 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.958276 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f289\" (UniqueName: \"kubernetes.io/projected/de8dcaac-1020-4c71-8277-1779fe212d84-kube-api-access-2f289\") pod \"node-resolver-86drl\" (UID: \"de8dcaac-1020-4c71-8277-1779fe212d84\") " pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:01.960209 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.960157 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nztgz\" (UniqueName: \"kubernetes.io/projected/c0a6c138-17a4-4284-b50c-655f558d88f1-kube-api-access-nztgz\") pod \"aws-ebs-csi-driver-node-jq9j6\" (UID: \"c0a6c138-17a4-4284-b50c-655f558d88f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:01.960560 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.960511 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2rfz\" (UniqueName: \"kubernetes.io/projected/8688453f-fca7-4ea0-8f02-d601b383693e-kube-api-access-w2rfz\") pod \"ovnkube-node-s7s8z\" (UID: \"8688453f-fca7-4ea0-8f02-d601b383693e\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:01.960819 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.960798 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g22sc\" (UniqueName: \"kubernetes.io/projected/bc406faa-9889-40ca-8c35-9b70d78bc8ca-kube-api-access-g22sc\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:01.961088 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:01.961067 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z69cm\" (UniqueName: \"kubernetes.io/projected/13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683-kube-api-access-z69cm\") pod \"node-ca-xgr7h\" (UID: \"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683\") " pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:02.003668 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.003614 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" event={"ID":"cbc50c4153caf2739fb4e20e06dc6519","Type":"ContainerStarted","Data":"28e556ae15eb99618ae9189f2428bc9c02e1a94e300983b5a69cc2577fc7e51d"} Jul 09 18:05:02.004869 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.004843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" event={"ID":"3a99e495f424a8870814d989f4c4e9e7","Type":"ContainerStarted","Data":"9ae40719ae1429ee85c5b2d59ee287f44ea243184dc2ae64870a48fb7c3596c6"} Jul 09 18:05:02.033443 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.033414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bt5tf" Jul 09 18:05:02.039648 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.039628 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" Jul 09 18:05:02.044832 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.044809 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4d13bc_0664_47b3_a939_36e068cc14f4.slice/crio-055435b236565e861d0d875043a6fe6a006741846acdf59a1224ac9e920433e0 WatchSource:0}: Error finding container 055435b236565e861d0d875043a6fe6a006741846acdf59a1224ac9e920433e0: Status 404 returned error can't find the container with id 055435b236565e861d0d875043a6fe6a006741846acdf59a1224ac9e920433e0 Jul 09 18:05:02.048531 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.048203 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqh66" Jul 09 18:05:02.050586 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.050564 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38338cd5_5bb7_4c99_8a1b_b22abf30b40c.slice/crio-0825d793243d3f3037bcfa973e45d07281f3318eb430dd90156d03a1aff14134 WatchSource:0}: Error finding container 0825d793243d3f3037bcfa973e45d07281f3318eb430dd90156d03a1aff14134: Status 404 returned error can't find the container with id 0825d793243d3f3037bcfa973e45d07281f3318eb430dd90156d03a1aff14134 Jul 09 18:05:02.052859 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.052701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" Jul 09 18:05:02.057666 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.057641 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4533e635_e32d_47e1_acb9_66901d8ddec4.slice/crio-239373440f8c1535402fbfaa41754fe917343cd36e2825debef7fb9e144f32dc WatchSource:0}: Error finding container 239373440f8c1535402fbfaa41754fe917343cd36e2825debef7fb9e144f32dc: Status 404 returned error can't find the container with id 239373440f8c1535402fbfaa41754fe917343cd36e2825debef7fb9e144f32dc Jul 09 18:05:02.058400 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.058351 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-86drl" Jul 09 18:05:02.063510 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.063484 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d712b2_606f_49cd_9ae8_ddfe017f732d.slice/crio-88da5b185f58597f24a619a8cc893152e5d5b3c7ea88b089dfe02acf1cd857e4 WatchSource:0}: Error finding container 88da5b185f58597f24a619a8cc893152e5d5b3c7ea88b089dfe02acf1cd857e4: Status 404 returned error can't find the container with id 88da5b185f58597f24a619a8cc893152e5d5b3c7ea88b089dfe02acf1cd857e4 Jul 09 18:05:02.064433 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.064392 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xgr7h" Jul 09 18:05:02.068386 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.068363 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8dcaac_1020_4c71_8277_1779fe212d84.slice/crio-7b608c8b918771f807461552cf233d74b4ee89c21345bfe85855a2e71433463d WatchSource:0}: Error finding container 7b608c8b918771f807461552cf233d74b4ee89c21345bfe85855a2e71433463d: Status 404 returned error can't find the container with id 7b608c8b918771f807461552cf233d74b4ee89c21345bfe85855a2e71433463d Jul 09 18:05:02.070336 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.070015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:02.073964 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.073941 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13acb9ea_6fda_4ab1_8fb7_f6fbcc39d683.slice/crio-e84d47a10d8cd64f35b592c2c285a62e590f58999d46828695fdaf0a272d9f52 WatchSource:0}: Error finding container e84d47a10d8cd64f35b592c2c285a62e590f58999d46828695fdaf0a272d9f52: Status 404 returned error can't find the container with id e84d47a10d8cd64f35b592c2c285a62e590f58999d46828695fdaf0a272d9f52 Jul 09 18:05:02.078162 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.077920 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:02.079812 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.079788 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5672ed_fabe_44ba_bc52_63ca5967df2c.slice/crio-95b7fc4ac5ed4f3421db1b58b12a0ecd5684c41b2823c424be992c4a96dfc304 WatchSource:0}: Error finding container 95b7fc4ac5ed4f3421db1b58b12a0ecd5684c41b2823c424be992c4a96dfc304: Status 404 returned error can't find the container with id 95b7fc4ac5ed4f3421db1b58b12a0ecd5684c41b2823c424be992c4a96dfc304 Jul 09 18:05:02.083310 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.083290 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" Jul 09 18:05:02.087522 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.087491 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8688453f_fca7_4ea0_8f02_d601b383693e.slice/crio-b390914958752393691d4f4dc76615bdf65c7c145c71d976212ea9e372fea78c WatchSource:0}: Error finding container b390914958752393691d4f4dc76615bdf65c7c145c71d976212ea9e372fea78c: Status 404 returned error can't find the container with id b390914958752393691d4f4dc76615bdf65c7c145c71d976212ea9e372fea78c Jul 09 18:05:02.092255 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:02.092238 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a6c138_17a4_4284_b50c_655f558d88f1.slice/crio-859940ada6283a3a58d742ebf215fe16f03651487fc963c67e16d0ba8463b673 WatchSource:0}: Error finding container 859940ada6283a3a58d742ebf215fe16f03651487fc963c67e16d0ba8463b673: Status 404 returned error can't find the container with id 859940ada6283a3a58d742ebf215fe16f03651487fc963c67e16d0ba8463b673 Jul 09 18:05:02.224990 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.224907 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:05:02.449812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.449771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:02.449990 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.449881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:02.449990 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.449961 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:02.450121 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.450006 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:02.450121 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.450046 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:05:03.450023806 +0000 UTC m=+4.099178456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:02.450121 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.450068 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:03.450057739 +0000 UTC m=+4.099212370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:02.551146 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.551050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:02.551306 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.551255 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:02.551306 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.551277 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:02.551306 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.551291 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:02.551471 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.551360 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:05:03.551336374 +0000 UTC m=+4.200491023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:02.780570 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.780510 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:00:02 +0000 UTC" deadline="2028-03-02 02:23:42.390007078 +0000 UTC" Jul 09 18:05:02.780570 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.780554 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14432h18m39.609457681s" Jul 09 18:05:02.998628 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:02.998594 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:02.998815 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:02.998782 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:03.010328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.010293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"b390914958752393691d4f4dc76615bdf65c7c145c71d976212ea9e372fea78c"} Jul 09 18:05:03.014977 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.014945 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xgr7h" event={"ID":"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683","Type":"ContainerStarted","Data":"e84d47a10d8cd64f35b592c2c285a62e590f58999d46828695fdaf0a272d9f52"} Jul 09 18:05:03.017955 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.017927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-86drl" event={"ID":"de8dcaac-1020-4c71-8277-1779fe212d84","Type":"ContainerStarted","Data":"7b608c8b918771f807461552cf233d74b4ee89c21345bfe85855a2e71433463d"} Jul 09 18:05:03.019898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.019832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqh66" event={"ID":"4533e635-e32d-47e1-acb9-66901d8ddec4","Type":"ContainerStarted","Data":"239373440f8c1535402fbfaa41754fe917343cd36e2825debef7fb9e144f32dc"} Jul 09 18:05:03.021868 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.021842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" event={"ID":"c0a6c138-17a4-4284-b50c-655f558d88f1","Type":"ContainerStarted","Data":"859940ada6283a3a58d742ebf215fe16f03651487fc963c67e16d0ba8463b673"} Jul 09 18:05:03.023610 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.023585 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7d6t2" event={"ID":"9d5672ed-fabe-44ba-bc52-63ca5967df2c","Type":"ContainerStarted","Data":"95b7fc4ac5ed4f3421db1b58b12a0ecd5684c41b2823c424be992c4a96dfc304"} Jul 09 18:05:03.026248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.026222 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerStarted","Data":"88da5b185f58597f24a619a8cc893152e5d5b3c7ea88b089dfe02acf1cd857e4"} Jul 09 18:05:03.027913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.027889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" event={"ID":"38338cd5-5bb7-4c99-8a1b-b22abf30b40c","Type":"ContainerStarted","Data":"0825d793243d3f3037bcfa973e45d07281f3318eb430dd90156d03a1aff14134"} Jul 09 18:05:03.030761 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.030698 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bt5tf" event={"ID":"7c4d13bc-0664-47b3-a939-36e068cc14f4","Type":"ContainerStarted","Data":"055435b236565e861d0d875043a6fe6a006741846acdf59a1224ac9e920433e0"} Jul 09 18:05:03.261173 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.260791 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:05:03.460696 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.459822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:03.460696 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.459911 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:03.460696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.460058 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:03.460696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.460124 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:05:05.460105241 +0000 UTC m=+6.109259872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:03.460696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.460585 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:03.460696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.460642 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:05.460624881 +0000 UTC m=+6.109779529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:03.561029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.560915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:03.561203 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.561124 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:03.561203 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.561150 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:03.561203 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.561164 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:03.561382 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.561227 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:05:05.561207036 +0000 UTC m=+6.210361677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:03.781019 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.780946 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:00:02 +0000 UTC" deadline="2028-01-25 04:36:40.950187969 +0000 UTC" Jul 09 18:05:03.781019 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.780986 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13546h31m37.169207009s" Jul 09 18:05:03.998891 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:03.998863 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:03.999023 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:03.998998 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:04.005616 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:04.005589 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:04.005806 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:04.005770 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:04.999142 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:04.999030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:04.999671 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:04.999189 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:05.480760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:05.480714 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:05.481066 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:05.480804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:05.481066 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.480946 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:05.481066 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.481016 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:05:09.480994038 +0000 UTC m=+10.130148667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:05.481471 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.481450 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:05.481575 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.481514 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:09.481495494 +0000 UTC m=+10.130650124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:05.581450 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:05.581410 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:05.581647 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.581626 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:05.581724 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.581652 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:05.581724 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.581666 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:05.581831 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.581725 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:05:09.581707215 +0000 UTC m=+10.230861848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:05.999620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:05.999588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:06.000098 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:05.999719 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:06.000379 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:06.000293 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:06.000474 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:06.000401 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:06.999746 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:06.999222 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:06.999746 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:06.999374 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:07.999704 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:07.999218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:07.999704 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:07.999348 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:08.000270 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:07.999710 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:08.000270 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:07.999806 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:08.998861 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:08.998822 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:08.999032 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:08.998971 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:09.513719 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:09.513677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:09.514114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:09.513755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:09.514114 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.513882 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:09.514114 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.513940 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:05:17.513920955 +0000 UTC m=+18.163075582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:09.514365 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.514348 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:09.514429 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.514401 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:17.514386996 +0000 UTC m=+18.163541623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:09.614290 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:09.614253 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:09.614513 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.614487 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:09.614513 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.614510 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:09.614696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.614522 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:09.614696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:09.614586 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:05:17.614568754 +0000 UTC m=+18.263723382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:10.000031 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:09.999994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:10.000173 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:10.000110 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:10.000464 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:10.000436 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:10.000577 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:10.000555 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:10.999383 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:10.999348 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:10.999845 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:10.999514 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:11.999200 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:11.998979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:11.999200 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:11.998979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:11.999200 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:11.999124 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:11.999200 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:11.999186 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:12.998832 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:12.998788 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:12.999019 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:12.998936 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:13.999665 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:13.999492 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:13.999665 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:13.999551 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:14.000149 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:13.999687 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:14.000149 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:13.999829 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:14.998944 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:14.998902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:14.999131 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:14.999055 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:15.998725 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:15.998688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:15.999117 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:15.998824 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:15.999117 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:15.998863 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:15.999117 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:15.998966 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:16.999236 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:16.999199 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:16.999761 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:16.999323 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:17.574284 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:17.574247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:17.574479 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:17.574310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:17.574479 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.574422 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:17.574479 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.574434 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:17.574645 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.574513 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:33.574491003 +0000 UTC m=+34.223645629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:17.574645 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.574534 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:05:33.574524511 +0000 UTC m=+34.223679136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:17.674639 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:17.674602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:17.674807 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.674757 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:17.674807 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.674777 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:17.674807 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.674788 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:17.674956 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.674853 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:05:33.674833545 +0000 UTC m=+34.323988191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:17.998932 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:17.998904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:17.999111 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:17.998911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:17.999111 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.999028 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:17.999237 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:17.999121 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:18.999115 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:18.999086 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:18.999502 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:18.999200 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:19.999327 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:19.999292 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:19.999816 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:19.999397 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:19.999816 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:19.999495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:19.999816 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:19.999601 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:20.998686 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:20.998640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:20.998868 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:20.998776 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:21.999347 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:21.999109 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:21.999347 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:21.999138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:21.999347 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:21.999317 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:21.999750 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:21.999425 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:22.076278 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:22.076248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" event={"ID":"3a99e495f424a8870814d989f4c4e9e7","Type":"ContainerStarted","Data":"b8d504543239183a612f3a9fa3d353359281e9f741754df3667dcb2afe63ce56"} Jul 09 18:05:22.083991 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:22.083963 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" event={"ID":"38338cd5-5bb7-4c99-8a1b-b22abf30b40c","Type":"ContainerStarted","Data":"5e310216076b76638194f7ec8b85a8018118fce26eadadb27d0f865a74efeb74"} Jul 09 18:05:22.089286 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:22.089260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"bf5fa6284e74a8cc6c4f684280b6e85c3b35040f601151028a0f95531bc471ca"} Jul 09 18:05:22.091231 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:22.091155 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" podStartSLOduration=21.091142968 podStartE2EDuration="21.091142968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:22.090635936 +0000 UTC m=+22.739790602" watchObservedRunningTime="2026-07-09 18:05:22.091142968 +0000 UTC m=+22.740297615" Jul 09 18:05:22.112247 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:22.112164 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2f7hk" podStartSLOduration=2.322139103 podStartE2EDuration="22.112143754s" totalImagesPullingTime="19.790004651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:22.111756235 +0000 UTC m=+22.760910882" watchObservedRunningTime="2026-07-09 18:05:22.112143754 +0000 UTC m=+22.761298407" Jul 09 18:05:22.999531 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:22.999305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:23.000295 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:22.999639 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:23.092108 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.092077 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" event={"ID":"c0a6c138-17a4-4284-b50c-655f558d88f1","Type":"ContainerStarted","Data":"b91402b1144914c21fdfb9cee8804aa813a368b116999505bb61fa1c03d15129"} Jul 09 18:05:23.093285 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.093260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7d6t2" event={"ID":"9d5672ed-fabe-44ba-bc52-63ca5967df2c","Type":"ContainerStarted","Data":"8712db2ff2014993fa9b1388afb2e174c9526f65d6b302664e500c80f20ec105"} Jul 09 18:05:23.094725 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.094702 2573 generic.go:356] "Generic (PLEG): container finished" podID="c3d712b2-606f-49cd-9ae8-ddfe017f732d" containerID="33eb76c010c675078d6acd458fcd9c73a626dc72b27acb20f176fd848b698534" exitCode=0 Jul 09 18:05:23.094817 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.094779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerDied","Data":"33eb76c010c675078d6acd458fcd9c73a626dc72b27acb20f176fd848b698534"} Jul 09 18:05:23.096212 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.096194 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bt5tf" event={"ID":"7c4d13bc-0664-47b3-a939-36e068cc14f4","Type":"ContainerStarted","Data":"ab49ca25f2a0f4d00f17cf86107c7ccd96d759ddbfe03723b4e7f202778fc6e7"} Jul 09 18:05:23.097569 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.097549 2573 generic.go:356] "Generic (PLEG): container finished" podID="cbc50c4153caf2739fb4e20e06dc6519" containerID="1887023a4cb79ce2f192ea523f8d3b40780150b8cdfa198aa38d99f2b091b4c8" exitCode=0 Jul 09 18:05:23.097648 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.097629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" event={"ID":"cbc50c4153caf2739fb4e20e06dc6519","Type":"ContainerDied","Data":"1887023a4cb79ce2f192ea523f8d3b40780150b8cdfa198aa38d99f2b091b4c8"} Jul 09 18:05:23.100199 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100181 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:05:23.100499 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100483 2573 generic.go:356] "Generic (PLEG): container finished" podID="8688453f-fca7-4ea0-8f02-d601b383693e" containerID="23a8051179556a52e105d820690e3adfc074943aab32c19065e67914b9d74a75" exitCode=1 Jul 09 18:05:23.100572 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerDied","Data":"23a8051179556a52e105d820690e3adfc074943aab32c19065e67914b9d74a75"} Jul 09 18:05:23.100629 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100612 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"89ef7b3399f3594d33efa56b6e3967bc441d627538dcf2cbab3a0bb4c2809354"} Jul 09 18:05:23.100685 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"6b20be0d2146fd04c8cc3bbcfae85961654c03271f4b8dcef750d673adb563e5"} Jul 09 18:05:23.100685 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100682 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"39ae9e1574a5278a5f78f9ea6e7b576df69736c682b2db0aa1ea42c36e3c0f1a"} Jul 09 18:05:23.100769 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.100709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"6d6d95f492f20c034d30ac3a189ccbd3560846dc27cbab2f39f5044b8c866b27"} Jul 09 18:05:23.101860 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.101840 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xgr7h" event={"ID":"13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683","Type":"ContainerStarted","Data":"9d9cbda178647783f8e9f8fe1da36eefe9f05df8d612b2352b904b90caba28d5"} Jul 09 18:05:23.103114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.103097 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-86drl" event={"ID":"de8dcaac-1020-4c71-8277-1779fe212d84","Type":"ContainerStarted","Data":"5959e06df5bdd6c61c8e054bd3ba241b9d90a46d8bf969c0ab7369d18ae41851"} Jul 09 18:05:23.104306 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.104287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqh66" event={"ID":"4533e635-e32d-47e1-acb9-66901d8ddec4","Type":"ContainerStarted","Data":"090711dba4d6dd581ae25936c27f7feacfd7833864df1b4ebae08a2b713885e9"} Jul 09 18:05:23.108873 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.108843 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7d6t2" podStartSLOduration=3.379855711 podStartE2EDuration="23.108832004s" totalImagesPullingTime="19.728976293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:23.108300269 +0000 UTC m=+23.757454919" watchObservedRunningTime="2026-07-09 18:05:23.108832004 +0000 UTC m=+23.757986651" Jul 09 18:05:23.123092 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.123059 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bt5tf" podStartSLOduration=3.360872629 podStartE2EDuration="23.123048592s" totalImagesPullingTime="19.762175963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:23.122529826 +0000 UTC m=+23.771684493" watchObservedRunningTime="2026-07-09 18:05:23.123048592 +0000 UTC m=+23.772203258" Jul 09 18:05:23.136785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.136749 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-86drl" podStartSLOduration=3.364858437 podStartE2EDuration="23.136737215s" totalImagesPullingTime="19.771878778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:23.136683773 +0000 UTC m=+23.785838421" watchObservedRunningTime="2026-07-09 18:05:23.136737215 +0000 UTC m=+23.785891859" Jul 09 18:05:23.153024 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.152989 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qqh66" podStartSLOduration=3.201757263 podStartE2EDuration="23.152973947s" totalImagesPullingTime="19.951216684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:23.152366341 +0000 UTC m=+23.801520989" watchObservedRunningTime="2026-07-09 18:05:23.152973947 +0000 UTC m=+23.802128594" Jul 09 18:05:23.189966 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.189920 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xgr7h" podStartSLOduration=3.862977122 podStartE2EDuration="23.18990143s" totalImagesPullingTime="19.326924308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:23.189884117 +0000 UTC m=+23.839038767" watchObservedRunningTime="2026-07-09 18:05:23.18990143 +0000 UTC m=+23.839056071" Jul 09 18:05:23.639658 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.639631 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 18:05:23.834699 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.834545 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:05:23.639653402Z","UUID":"d7c5c361-9e50-4d93-8641-1305da7f003f","Handler":null,"Name":"","Endpoint":""} Jul 09 18:05:23.836080 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.836057 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 18:05:23.836200 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.836101 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 18:05:23.998516 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.998487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:23.998737 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:23.998490 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:23.998737 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:23.998604 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:23.998737 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:23.998709 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:24.077643 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:24.077612 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:24.078651 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:24.078636 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:24.108689 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:24.108613 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" event={"ID":"c0a6c138-17a4-4284-b50c-655f558d88f1","Type":"ContainerStarted","Data":"023420460b510e21c7243aca30b8a90b1da6c06af7d2baed3f2f09acc7d96eb4"} Jul 09 18:05:24.110643 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:24.110618 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" event={"ID":"cbc50c4153caf2739fb4e20e06dc6519","Type":"ContainerStarted","Data":"b67e4aa75d3db004e84f6f1ca25aff652e98e08443de196c6e5a0bcca133fceb"} Jul 09 18:05:24.126988 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:24.126938 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" podStartSLOduration=23.126919032 podStartE2EDuration="23.126919032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:24.126238346 +0000 UTC m=+24.775393002" watchObservedRunningTime="2026-07-09 18:05:24.126919032 +0000 UTC m=+24.776073685" Jul 09 18:05:24.998829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:24.998648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:24.998978 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:24.998927 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:25.116175 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.116145 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:05:25.116591 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.116564 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"6c963eb9a5a80138ecaad2a261664f98a08e01b5dca2b49c0893d7ecda940712"} Jul 09 18:05:25.116636 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.116612 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 18:05:25.829413 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.829375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:25.829914 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.829892 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7d6t2" Jul 09 18:05:25.998856 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.998821 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:25.999048 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:25.998969 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:25.999048 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:25.998990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:25.999162 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:25.999100 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:26.120863 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:26.120782 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" event={"ID":"c0a6c138-17a4-4284-b50c-655f558d88f1","Type":"ContainerStarted","Data":"634a44d49b65ddad5190972cbe27771544077ef23f991c300c039d503776166a"} Jul 09 18:05:26.138294 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:26.138251 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq9j6" podStartSLOduration=4.194570516 podStartE2EDuration="26.138231239s" totalImagesPullingTime="21.943660723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:26.137817635 +0000 UTC m=+26.786972282" watchObservedRunningTime="2026-07-09 18:05:26.138231239 +0000 UTC m=+26.787385890" Jul 09 18:05:26.999098 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:26.999059 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:26.999274 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:26.999199 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:27.999327 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:27.999290 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:27.999941 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:27.999300 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:27.999941 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:27.999428 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:27.999941 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:27.999505 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:28.998995 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:28.998768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:28.999129 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:28.999016 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:29.128265 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.128230 2573 generic.go:356] "Generic (PLEG): container finished" podID="c3d712b2-606f-49cd-9ae8-ddfe017f732d" containerID="41e9dcf29bd09a32536f64ca077c84081dc00b026154488326f23f7fcde08bb6" exitCode=0 Jul 09 18:05:29.128861 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.128285 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerDied","Data":"41e9dcf29bd09a32536f64ca077c84081dc00b026154488326f23f7fcde08bb6"} Jul 09 18:05:29.136100 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.135968 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:05:29.136407 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.136383 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"f87c18018f52d1c586e4020c43015ab011c4e785036c14f2f88f46a5fa00b7f2"} Jul 09 18:05:29.136688 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.136671 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:29.136862 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.136840 2573 scope.go:117] "RemoveContainer" containerID="23a8051179556a52e105d820690e3adfc074943aab32c19065e67914b9d74a75" Jul 09 18:05:29.152283 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:29.152262 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:30.000060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.000027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:30.000328 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:30.000107 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:30.000328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.000212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:30.000415 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:30.000336 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:30.140937 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.140849 2573 generic.go:356] "Generic (PLEG): container finished" podID="c3d712b2-606f-49cd-9ae8-ddfe017f732d" containerID="920c3be847f4e4bfc7798f324cffc67b8b74bcdb41cf9ad1990d522a71431247" exitCode=0 Jul 09 18:05:30.141326 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.140937 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerDied","Data":"920c3be847f4e4bfc7798f324cffc67b8b74bcdb41cf9ad1990d522a71431247"} Jul 09 18:05:30.144650 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.144629 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:05:30.146682 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.145182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" event={"ID":"8688453f-fca7-4ea0-8f02-d601b383693e","Type":"ContainerStarted","Data":"a00188d4988a62a74645016b2a57f1ea2a00d194c3fcc7992c01c2c3a4c1f521"} Jul 09 18:05:30.146682 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.146553 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:30.146682 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.146647 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:30.163025 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.163001 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:05:30.195279 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.195226 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" podStartSLOduration=10.431328773 podStartE2EDuration="30.195212542s" totalImagesPullingTime="19.763883769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:30.194635522 +0000 UTC m=+30.843790191" watchObservedRunningTime="2026-07-09 18:05:30.195212542 +0000 UTC m=+30.844367188" Jul 09 18:05:30.998862 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:30.998830 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:30.999078 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:30.998943 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:31.150024 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:31.149942 2573 generic.go:356] "Generic (PLEG): container finished" podID="c3d712b2-606f-49cd-9ae8-ddfe017f732d" containerID="c5483c161ed58f4a58b3e6022ea048b9b6fd194b87c8f01bc0f2791e9e8ba162" exitCode=0 Jul 09 18:05:31.150443 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:31.150022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerDied","Data":"c5483c161ed58f4a58b3e6022ea048b9b6fd194b87c8f01bc0f2791e9e8ba162"} Jul 09 18:05:31.998846 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:31.998645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:31.999014 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:31.998645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:31.999014 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:31.998941 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:31.999014 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:31.998993 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:32.998908 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:32.998875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:32.999290 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:32.998984 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:33.594590 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:33.594553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:33.594783 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:33.594634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:33.594783 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.594696 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:33.594783 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.594763 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret podName:69e420c6-bf61-46ff-a147-9b5b653a237a nodeName:}" failed. No retries permitted until 2026-07-09 18:06:05.594744461 +0000 UTC m=+66.243899086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret") pod "global-pull-secret-syncer-hz6fn" (UID: "69e420c6-bf61-46ff-a147-9b5b653a237a") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:05:33.594783 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.594764 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:33.594964 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.594815 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs podName:bc406faa-9889-40ca-8c35-9b70d78bc8ca nodeName:}" failed. No retries permitted until 2026-07-09 18:06:05.594799362 +0000 UTC m=+66.243954001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs") pod "network-metrics-daemon-7qkqj" (UID: "bc406faa-9889-40ca-8c35-9b70d78bc8ca") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:05:33.695308 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:33.695272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:33.695489 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.695434 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:05:33.695489 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.695468 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:05:33.695489 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.695480 2573 projected.go:196] Error preparing data for projected volume kube-api-access-k8kdr for pod openshift-network-diagnostics/network-check-target-p2j48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:33.695639 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.695529 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr podName:a421478f-4388-4cbe-aada-bc3f0e638fec nodeName:}" failed. No retries permitted until 2026-07-09 18:06:05.695514886 +0000 UTC m=+66.344669514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8kdr" (UniqueName: "kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr") pod "network-check-target-p2j48" (UID: "a421478f-4388-4cbe-aada-bc3f0e638fec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:05:33.998497 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:33.998465 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:33.998497 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:33.998479 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:33.998731 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.998578 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:33.998788 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:33.998719 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:34.999306 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:34.999265 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:34.999789 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:34.999408 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:35.999368 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:35.999340 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:35.999368 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:35.999337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:35.999757 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:35.999522 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:35.999757 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:35.999554 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:36.166858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:36.165031 2573 generic.go:356] "Generic (PLEG): container finished" podID="c3d712b2-606f-49cd-9ae8-ddfe017f732d" containerID="b03d4af6b27f0d5dcf014f381e80200c94fa9761e9a7afd1b9f18340fd4df896" exitCode=0 Jul 09 18:05:36.166858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:36.165080 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerDied","Data":"b03d4af6b27f0d5dcf014f381e80200c94fa9761e9a7afd1b9f18340fd4df896"} Jul 09 18:05:36.998402 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:36.998371 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:36.998961 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:36.998498 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:37.170241 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:37.170208 2573 generic.go:356] "Generic (PLEG): container finished" podID="c3d712b2-606f-49cd-9ae8-ddfe017f732d" containerID="d1da7321293a3ac41b22b05efed6dce807ae1893ca645192cdf5512f180ad966" exitCode=0 Jul 09 18:05:37.170633 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:37.170268 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerDied","Data":"d1da7321293a3ac41b22b05efed6dce807ae1893ca645192cdf5512f180ad966"} Jul 09 18:05:37.998799 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:37.998767 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:37.998972 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:37.998771 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:37.998972 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:37.998873 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:37.998972 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:37.998922 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:38.175500 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:38.175440 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" event={"ID":"c3d712b2-606f-49cd-9ae8-ddfe017f732d","Type":"ContainerStarted","Data":"b140ee4fa3dd625ea4e4617c459ed8afefa9da24b0d01753c710e4f91e813abc"} Jul 09 18:05:38.199976 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:38.199931 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zbnmz" podStartSLOduration=6.910589504 podStartE2EDuration="38.199916923s" totalImagesPullingTime="31.289327419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:38.199371683 +0000 UTC m=+38.848526330" watchObservedRunningTime="2026-07-09 18:05:38.199916923 +0000 UTC m=+38.849071570" Jul 09 18:05:38.999048 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:38.999014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:38.999232 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:38.999116 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:39.912755 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:39.912717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hz6fn"] Jul 09 18:05:39.913665 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:39.912857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:39.913665 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:39.912958 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:39.915402 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:39.915376 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7qkqj"] Jul 09 18:05:39.915568 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:39.915536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:39.915674 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:39.915652 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:39.927046 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:39.927016 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2j48"] Jul 09 18:05:39.927161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:39.927107 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:39.927206 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:39.927186 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:41.998923 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:41.998878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:41.999406 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:41.998878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:41.999406 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:41.999002 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6fn" podUID="69e420c6-bf61-46ff-a147-9b5b653a237a" Jul 09 18:05:41.999406 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:41.999015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:41.999406 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:41.999093 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qkqj" podUID="bc406faa-9889-40ca-8c35-9b70d78bc8ca" Jul 09 18:05:41.999406 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:41.999171 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2j48" podUID="a421478f-4388-4cbe-aada-bc3f0e638fec" Jul 09 18:05:43.692033 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.691794 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeReady" Jul 09 18:05:43.692372 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.692078 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 18:05:43.735407 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.735371 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-27zzq"] Jul 09 18:05:43.757480 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.757433 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cx2h4"] Jul 09 18:05:43.757623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.757543 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.760688 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.760668 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sdwn\"" Jul 09 18:05:43.760909 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.760850 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 18:05:43.761362 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.761345 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 18:05:43.772144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.772123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90c48ae0-5b80-4019-96a9-261e34633226-config-volume\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.772225 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.772149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c48ae0-5b80-4019-96a9-261e34633226-metrics-tls\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.772225 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.772179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94hch\" (UniqueName: \"kubernetes.io/projected/90c48ae0-5b80-4019-96a9-261e34633226-kube-api-access-94hch\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.772295 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.772243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c48ae0-5b80-4019-96a9-261e34633226-tmp-dir\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.781433 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.781409 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-27zzq"] Jul 09 18:05:43.781528 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.781438 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cx2h4"] Jul 09 18:05:43.781528 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.781486 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.784159 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.784129 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qd2fl\"" Jul 09 18:05:43.784265 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.784160 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 18:05:43.784265 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.784186 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 18:05:43.784265 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.784246 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 18:05:43.784394 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.784273 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 18:05:43.841691 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.841666 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-st8cw"] Jul 09 18:05:43.867565 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.867533 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-st8cw"] Jul 09 18:05:43.867759 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.867636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.871887 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.871867 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 18:05:43.872040 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872022 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rtw6h\"" Jul 09 18:05:43.872097 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 18:05:43.872570 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c48ae0-5b80-4019-96a9-261e34633226-tmp-dir\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.872678 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90c48ae0-5b80-4019-96a9-261e34633226-config-volume\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.872678 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c48ae0-5b80-4019-96a9-261e34633226-metrics-tls\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.872785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94hch\" (UniqueName: \"kubernetes.io/projected/90c48ae0-5b80-4019-96a9-261e34633226-kube-api-access-94hch\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.872785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957ac53-29f9-4315-9728-e39db265e3a0-data-volume\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.872785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b957ac53-29f9-4315-9728-e39db265e3a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.872785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872781 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbff\" (UniqueName: \"kubernetes.io/projected/b957ac53-29f9-4315-9728-e39db265e3a0-kube-api-access-kwbff\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.872975 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d88n\" (UniqueName: \"kubernetes.io/projected/225fb693-c1e1-42be-9cda-b113e86894ab-kube-api-access-6d88n\") pod \"ingress-canary-st8cw\" (UID: \"225fb693-c1e1-42be-9cda-b113e86894ab\") " pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.872975 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b957ac53-29f9-4315-9728-e39db265e3a0-crio-socket\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.872975 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/225fb693-c1e1-42be-9cda-b113e86894ab-cert\") pod \"ingress-canary-st8cw\" (UID: \"225fb693-c1e1-42be-9cda-b113e86894ab\") " pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.872975 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b957ac53-29f9-4315-9728-e39db265e3a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.872975 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.872929 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c48ae0-5b80-4019-96a9-261e34633226-tmp-dir\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.873227 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.873107 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 18:05:43.873284 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.873251 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90c48ae0-5b80-4019-96a9-261e34633226-config-volume\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.876779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.876760 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c48ae0-5b80-4019-96a9-261e34633226-metrics-tls\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.883198 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.883179 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94hch\" (UniqueName: \"kubernetes.io/projected/90c48ae0-5b80-4019-96a9-261e34633226-kube-api-access-94hch\") pod \"dns-default-27zzq\" (UID: \"90c48ae0-5b80-4019-96a9-261e34633226\") " pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:43.973759 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973672 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957ac53-29f9-4315-9728-e39db265e3a0-data-volume\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.973759 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b957ac53-29f9-4315-9728-e39db265e3a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.973952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbff\" (UniqueName: \"kubernetes.io/projected/b957ac53-29f9-4315-9728-e39db265e3a0-kube-api-access-kwbff\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.973952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d88n\" (UniqueName: \"kubernetes.io/projected/225fb693-c1e1-42be-9cda-b113e86894ab-kube-api-access-6d88n\") pod \"ingress-canary-st8cw\" (UID: \"225fb693-c1e1-42be-9cda-b113e86894ab\") " pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.973952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b957ac53-29f9-4315-9728-e39db265e3a0-crio-socket\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.973952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973921 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/225fb693-c1e1-42be-9cda-b113e86894ab-cert\") pod \"ingress-canary-st8cw\" (UID: \"225fb693-c1e1-42be-9cda-b113e86894ab\") " pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.973952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.973944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b957ac53-29f9-4315-9728-e39db265e3a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.974205 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.974031 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957ac53-29f9-4315-9728-e39db265e3a0-data-volume\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.974205 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.974167 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b957ac53-29f9-4315-9728-e39db265e3a0-crio-socket\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.974821 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.974799 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b957ac53-29f9-4315-9728-e39db265e3a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.976114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.976092 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b957ac53-29f9-4315-9728-e39db265e3a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.976345 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.976329 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/225fb693-c1e1-42be-9cda-b113e86894ab-cert\") pod \"ingress-canary-st8cw\" (UID: \"225fb693-c1e1-42be-9cda-b113e86894ab\") " pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.981966 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.981947 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d88n\" (UniqueName: \"kubernetes.io/projected/225fb693-c1e1-42be-9cda-b113e86894ab-kube-api-access-6d88n\") pod \"ingress-canary-st8cw\" (UID: \"225fb693-c1e1-42be-9cda-b113e86894ab\") " pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:43.982216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.982198 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbff\" (UniqueName: \"kubernetes.io/projected/b957ac53-29f9-4315-9728-e39db265e3a0-kube-api-access-kwbff\") pod \"insights-runtime-extractor-cx2h4\" (UID: \"b957ac53-29f9-4315-9728-e39db265e3a0\") " pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:43.999271 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.999251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:05:43.999271 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.999262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:05:43.999406 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:43.999269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:05:44.002512 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.002489 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 18:05:44.002590 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.002531 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 18:05:44.002690 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.002672 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6mch4\"" Jul 09 18:05:44.002690 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.002687 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkf52\"" Jul 09 18:05:44.002813 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.002740 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 18:05:44.002813 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.002768 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 18:05:44.067338 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.067308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:44.089744 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.089713 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cx2h4" Jul 09 18:05:44.176150 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.175893 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-st8cw" Jul 09 18:05:44.254721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.254613 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-27zzq"] Jul 09 18:05:44.259053 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:44.259029 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c48ae0_5b80_4019_96a9_261e34633226.slice/crio-02abb9b5bc23bdb4a04392345882836cdbe8fb30878b988816a4f0b85b57b7be WatchSource:0}: Error finding container 02abb9b5bc23bdb4a04392345882836cdbe8fb30878b988816a4f0b85b57b7be: Status 404 returned error can't find the container with id 02abb9b5bc23bdb4a04392345882836cdbe8fb30878b988816a4f0b85b57b7be Jul 09 18:05:44.262568 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.262494 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cx2h4"] Jul 09 18:05:44.266599 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:44.266576 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb957ac53_29f9_4315_9728_e39db265e3a0.slice/crio-fd20ef29d84f4c2497d03a94185fa16459206e75a9d25d7d26a20545bee55d22 WatchSource:0}: Error finding container fd20ef29d84f4c2497d03a94185fa16459206e75a9d25d7d26a20545bee55d22: Status 404 returned error can't find the container with id fd20ef29d84f4c2497d03a94185fa16459206e75a9d25d7d26a20545bee55d22 Jul 09 18:05:44.300833 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.300808 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f857895dd-6jnm4"] Jul 09 18:05:44.328052 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.328024 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f857895dd-6jnm4"] Jul 09 18:05:44.328188 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.328111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.328483 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.328443 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-st8cw"] Jul 09 18:05:44.330905 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.330884 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 18:05:44.331013 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.330908 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 18:05:44.331013 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.330884 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 18:05:44.331013 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.330891 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 18:05:44.331013 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.331007 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 18:05:44.331257 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.331061 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mnhsr\"" Jul 09 18:05:44.331257 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.331081 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 18:05:44.331390 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.331338 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 18:05:44.332567 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:44.332535 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225fb693_c1e1_42be_9cda_b113e86894ab.slice/crio-cbeb9ec062207a810fc9f37ed1e61b04a0247319839ba7c75269ce355cb54b36 WatchSource:0}: Error finding container cbeb9ec062207a810fc9f37ed1e61b04a0247319839ba7c75269ce355cb54b36: Status 404 returned error can't find the container with id cbeb9ec062207a810fc9f37ed1e61b04a0247319839ba7c75269ce355cb54b36 Jul 09 18:05:44.377482 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.377441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-service-ca\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.377587 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.377532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-serving-cert\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.377587 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.377551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-oauth-config\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.377587 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.377570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-oauth-serving-cert\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.377688 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.377608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmnfm\" (UniqueName: \"kubernetes.io/projected/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-kube-api-access-nmnfm\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.377688 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.377660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-config\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.478870 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.478836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-config\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.478985 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.478877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-service-ca\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.478985 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.478943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-serving-cert\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.478985 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.478964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-oauth-config\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.479108 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.478990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-oauth-serving-cert\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.479174 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.479150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmnfm\" (UniqueName: \"kubernetes.io/projected/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-kube-api-access-nmnfm\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.479773 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.479750 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-oauth-serving-cert\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.479859 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.479779 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-config\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.479859 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.479783 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-service-ca\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.482534 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.482518 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-oauth-config\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.482590 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.482564 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-serving-cert\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.487784 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.487758 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmnfm\" (UniqueName: \"kubernetes.io/projected/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-kube-api-access-nmnfm\") pod \"console-6f857895dd-6jnm4\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.638591 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.638522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:44.781326 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:44.781298 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f857895dd-6jnm4"] Jul 09 18:05:44.785056 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:44.785036 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7ba552_86b8_4b8d_9801_4ac804fdcdb0.slice/crio-e6f3fcfe927aee3a5be0c2d79fbff987ab33174da2f29298982d124e387c9ec4 WatchSource:0}: Error finding container e6f3fcfe927aee3a5be0c2d79fbff987ab33174da2f29298982d124e387c9ec4: Status 404 returned error can't find the container with id e6f3fcfe927aee3a5be0c2d79fbff987ab33174da2f29298982d124e387c9ec4 Jul 09 18:05:45.194798 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:45.194732 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-st8cw" event={"ID":"225fb693-c1e1-42be-9cda-b113e86894ab","Type":"ContainerStarted","Data":"cbeb9ec062207a810fc9f37ed1e61b04a0247319839ba7c75269ce355cb54b36"} Jul 09 18:05:45.196065 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:45.196032 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cx2h4" event={"ID":"b957ac53-29f9-4315-9728-e39db265e3a0","Type":"ContainerStarted","Data":"fd20ef29d84f4c2497d03a94185fa16459206e75a9d25d7d26a20545bee55d22"} Jul 09 18:05:45.197769 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:45.197738 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27zzq" event={"ID":"90c48ae0-5b80-4019-96a9-261e34633226","Type":"ContainerStarted","Data":"02abb9b5bc23bdb4a04392345882836cdbe8fb30878b988816a4f0b85b57b7be"} Jul 09 18:05:45.199328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:45.199261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f857895dd-6jnm4" event={"ID":"da7ba552-86b8-4b8d-9801-4ac804fdcdb0","Type":"ContainerStarted","Data":"e6f3fcfe927aee3a5be0c2d79fbff987ab33174da2f29298982d124e387c9ec4"} Jul 09 18:05:46.262425 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.261903 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nwql5"] Jul 09 18:05:46.279434 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.278593 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nwql5"] Jul 09 18:05:46.279434 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.278724 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.283488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.281505 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 18:05:46.283488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.281763 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 18:05:46.283488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.281854 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 18:05:46.283488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.281963 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 18:05:46.283488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.281763 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vfm25\"" Jul 09 18:05:46.283488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.282812 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 18:05:46.296738 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.296713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690d812e-a611-446c-8b76-b6acf313a162-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.296856 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.296747 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rs6z\" (UniqueName: \"kubernetes.io/projected/690d812e-a611-446c-8b76-b6acf313a162-kube-api-access-2rs6z\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.296856 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.296807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690d812e-a611-446c-8b76-b6acf313a162-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.296970 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.296881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/690d812e-a611-446c-8b76-b6acf313a162-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.397271 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.397232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/690d812e-a611-446c-8b76-b6acf313a162-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.397435 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.397362 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690d812e-a611-446c-8b76-b6acf313a162-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.397435 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.397394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rs6z\" (UniqueName: \"kubernetes.io/projected/690d812e-a611-446c-8b76-b6acf313a162-kube-api-access-2rs6z\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.397575 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.397436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690d812e-a611-446c-8b76-b6acf313a162-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.398224 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.398199 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690d812e-a611-446c-8b76-b6acf313a162-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.410482 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.404291 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690d812e-a611-446c-8b76-b6acf313a162-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.410482 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.405508 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/690d812e-a611-446c-8b76-b6acf313a162-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.418713 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.418662 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rs6z\" (UniqueName: \"kubernetes.io/projected/690d812e-a611-446c-8b76-b6acf313a162-kube-api-access-2rs6z\") pod \"prometheus-operator-64785b6675-nwql5\" (UID: \"690d812e-a611-446c-8b76-b6acf313a162\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:46.591688 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:46.591600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" Jul 09 18:05:52.114497 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.114336 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nwql5"] Jul 09 18:05:52.116970 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:52.116945 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690d812e_a611_446c_8b76_b6acf313a162.slice/crio-0802b31c827ce204d481aa839c587bc0de487a44c891060d1c8bb0782b9a8606 WatchSource:0}: Error finding container 0802b31c827ce204d481aa839c587bc0de487a44c891060d1c8bb0782b9a8606: Status 404 returned error can't find the container with id 0802b31c827ce204d481aa839c587bc0de487a44c891060d1c8bb0782b9a8606 Jul 09 18:05:52.222931 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.222746 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-st8cw" event={"ID":"225fb693-c1e1-42be-9cda-b113e86894ab","Type":"ContainerStarted","Data":"c84b739445fd32590919b69edb00ac2a9b0341a3525b7145f9850d7a4c4b9247"} Jul 09 18:05:52.224241 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.224212 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" event={"ID":"690d812e-a611-446c-8b76-b6acf313a162","Type":"ContainerStarted","Data":"0802b31c827ce204d481aa839c587bc0de487a44c891060d1c8bb0782b9a8606"} Jul 09 18:05:52.225478 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.225439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cx2h4" event={"ID":"b957ac53-29f9-4315-9728-e39db265e3a0","Type":"ContainerStarted","Data":"654440a4e273c75b33aedc09b961ad1c01b9b9397c47ba23cf010b98fb27ab72"} Jul 09 18:05:52.227265 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.227218 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27zzq" event={"ID":"90c48ae0-5b80-4019-96a9-261e34633226","Type":"ContainerStarted","Data":"7293d28cc8ac5a78e50e5887d138f44936217f4797921501137507bd395a22bf"} Jul 09 18:05:52.228793 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.228754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f857895dd-6jnm4" event={"ID":"da7ba552-86b8-4b8d-9801-4ac804fdcdb0","Type":"ContainerStarted","Data":"5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704"} Jul 09 18:05:52.243861 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.243812 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-st8cw" podStartSLOduration=1.6247330629999999 podStartE2EDuration="9.243792815s" totalImagesPullingTime="7.619059752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:52.24293806 +0000 UTC m=+52.892092707" watchObservedRunningTime="2026-07-09 18:05:52.243792815 +0000 UTC m=+52.892947460" Jul 09 18:05:52.263646 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:52.263436 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f857895dd-6jnm4" podStartSLOduration=1.067388912 podStartE2EDuration="8.263417579s" totalImagesPullingTime="7.196028667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:52.263145224 +0000 UTC m=+52.912299884" watchObservedRunningTime="2026-07-09 18:05:52.263417579 +0000 UTC m=+52.912572227" Jul 09 18:05:53.235562 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:53.235520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27zzq" event={"ID":"90c48ae0-5b80-4019-96a9-261e34633226","Type":"ContainerStarted","Data":"c4749518cc5b59dd911b58cfc126299eecc8d27eaa8a4c1626ad2cb44eb4a394"} Jul 09 18:05:53.255799 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:53.255753 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-27zzq" podStartSLOduration=2.890615146 podStartE2EDuration="10.2557372s" totalImagesPullingTime="7.365122054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:53.254711799 +0000 UTC m=+53.903866447" watchObservedRunningTime="2026-07-09 18:05:53.2557372 +0000 UTC m=+53.904891825" Jul 09 18:05:54.241513 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.241251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" event={"ID":"690d812e-a611-446c-8b76-b6acf313a162","Type":"ContainerStarted","Data":"2a2ab2e89e70a66c15fd4acf8c017d8f6c5812a1f801d0f25e804ae727c90bf4"} Jul 09 18:05:54.242150 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.241545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" event={"ID":"690d812e-a611-446c-8b76-b6acf313a162","Type":"ContainerStarted","Data":"e558ccfdec1c80d88f76ac2883ec22b0ff982269f0dd923f5f1d6c5115df353b"} Jul 09 18:05:54.243176 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.243150 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cx2h4" event={"ID":"b957ac53-29f9-4315-9728-e39db265e3a0","Type":"ContainerStarted","Data":"9c2103149af563e6de1834803dbbc55210ec8490a7c497e586058f9fa7b4f2f5"} Jul 09 18:05:54.243391 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.243375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-27zzq" Jul 09 18:05:54.259071 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.258946 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-nwql5" podStartSLOduration=6.719994118 podStartE2EDuration="8.258928721s" totalImagesPullingTime="1.538934603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:54.258409479 +0000 UTC m=+54.907564148" watchObservedRunningTime="2026-07-09 18:05:54.258928721 +0000 UTC m=+54.908083367" Jul 09 18:05:54.639198 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.639105 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:54.639198 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.639162 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:54.644747 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.644724 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:54.696898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.696861 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5755899d96-b62xh"] Jul 09 18:05:54.699161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.699138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.707568 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.707412 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 18:05:54.712011 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.711982 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5755899d96-b62xh"] Jul 09 18:05:54.764307 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764275 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-config\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.764491 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-serving-cert\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.764491 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764344 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-oauth-config\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.764491 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-trusted-ca-bundle\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.764491 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764469 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7dhs\" (UniqueName: \"kubernetes.io/projected/402cc5c9-84f8-4014-ba8f-9ded88b28edc-kube-api-access-z7dhs\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.764708 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-service-ca\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.764708 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.764589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-oauth-serving-cert\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865257 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-trusted-ca-bundle\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865257 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7dhs\" (UniqueName: \"kubernetes.io/projected/402cc5c9-84f8-4014-ba8f-9ded88b28edc-kube-api-access-z7dhs\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865515 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865314 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-service-ca\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865515 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-oauth-serving-cert\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865515 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-config\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865515 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-serving-cert\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.865515 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.865431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-oauth-config\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.866341 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.866310 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-trusted-ca-bundle\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.866472 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.866307 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-oauth-serving-cert\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.866472 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.866409 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-config\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.866618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.866516 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-service-ca\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.870438 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.870408 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-oauth-config\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.870567 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.870427 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-serving-cert\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:54.874481 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:54.874437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7dhs\" (UniqueName: \"kubernetes.io/projected/402cc5c9-84f8-4014-ba8f-9ded88b28edc-kube-api-access-z7dhs\") pod \"console-5755899d96-b62xh\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:55.010678 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:55.010640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:05:55.151441 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:55.151212 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5755899d96-b62xh"] Jul 09 18:05:55.251670 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:55.251639 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:05:56.158060 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:56.158019 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402cc5c9_84f8_4014_ba8f_9ded88b28edc.slice/crio-6b3a29e7f9c01d646f04932d6e0575f650bea960cc13ff834f09a1725bc7df72 WatchSource:0}: Error finding container 6b3a29e7f9c01d646f04932d6e0575f650bea960cc13ff834f09a1725bc7df72: Status 404 returned error can't find the container with id 6b3a29e7f9c01d646f04932d6e0575f650bea960cc13ff834f09a1725bc7df72 Jul 09 18:05:56.252957 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.252926 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cx2h4" event={"ID":"b957ac53-29f9-4315-9728-e39db265e3a0","Type":"ContainerStarted","Data":"d886358bf01edfaa5b4e201cabf0d900dbc3b0dd31bcdf8bf323091100b21f73"} Jul 09 18:05:56.254760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.254733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755899d96-b62xh" event={"ID":"402cc5c9-84f8-4014-ba8f-9ded88b28edc","Type":"ContainerStarted","Data":"f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b"} Jul 09 18:05:56.254884 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.254778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755899d96-b62xh" event={"ID":"402cc5c9-84f8-4014-ba8f-9ded88b28edc","Type":"ContainerStarted","Data":"6b3a29e7f9c01d646f04932d6e0575f650bea960cc13ff834f09a1725bc7df72"} Jul 09 18:05:56.270585 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.270539 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cx2h4" podStartSLOduration=1.625820813 podStartE2EDuration="13.270519712s" totalImagesPullingTime="11.644698899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:56.269027999 +0000 UTC m=+56.918182646" watchObservedRunningTime="2026-07-09 18:05:56.270519712 +0000 UTC m=+56.919674359" Jul 09 18:05:56.294281 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.294225 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5755899d96-b62xh" podStartSLOduration=2.294203549 podStartE2EDuration="2.294203549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:56.293275914 +0000 UTC m=+56.942430581" watchObservedRunningTime="2026-07-09 18:05:56.294203549 +0000 UTC m=+56.943358197" Jul 09 18:05:56.622717 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.622685 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76"] Jul 09 18:05:56.625069 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.625053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.627765 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.627743 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 18:05:56.627765 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.627760 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 18:05:56.627929 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.627911 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9x5bc\"" Jul 09 18:05:56.632072 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.632055 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4zr7p"] Jul 09 18:05:56.634408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.634392 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.638444 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.638426 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 18:05:56.638764 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.638746 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 18:05:56.639578 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.639562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lv477\"" Jul 09 18:05:56.639681 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.639640 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 18:05:56.639754 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.639735 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76"] Jul 09 18:05:56.659491 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.659464 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4zr7p"] Jul 09 18:05:56.663485 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.663465 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-blfvg"] Jul 09 18:05:56.665565 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.665552 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.668544 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.668522 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 18:05:56.668854 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.668839 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l75qs\"" Jul 09 18:05:56.668909 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.668853 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 18:05:56.668909 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.668877 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 18:05:56.680651 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.680737 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.680737 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.680803 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e7756f7-a36b-49be-887c-ab6356227b77-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.680803 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gql2\" (UniqueName: \"kubernetes.io/projected/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-kube-api-access-2gql2\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.680803 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkfhb\" (UniqueName: \"kubernetes.io/projected/8e7756f7-a36b-49be-887c-ab6356227b77-kube-api-access-wkfhb\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.680898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.680898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e7756f7-a36b-49be-887c-ab6356227b77-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.680898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.680980 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.680898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.782052 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.782052 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrg8b\" (UniqueName: \"kubernetes.io/projected/722ecfba-1de0-4e94-a306-577a58500178-kube-api-access-wrg8b\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.782333 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.782333 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:56.782216 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 18:05:56.782333 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e7756f7-a36b-49be-887c-ab6356227b77-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.782333 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:56.782261 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-tls podName:8e7756f7-a36b-49be-887c-ab6356227b77 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:57.282246383 +0000 UTC m=+57.931401008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-4zr7p" (UID: "8e7756f7-a36b-49be-887c-ab6356227b77") : secret "kube-state-metrics-tls" not found Jul 09 18:05:56.782333 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gql2\" (UniqueName: \"kubernetes.io/projected/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-kube-api-access-2gql2\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.782333 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkfhb\" (UniqueName: \"kubernetes.io/projected/8e7756f7-a36b-49be-887c-ab6356227b77-kube-api-access-wkfhb\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.782774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.782774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e7756f7-a36b-49be-887c-ab6356227b77-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.782774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-textfile\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.782774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.782774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/722ecfba-1de0-4e94-a306-577a58500178-metrics-client-ca\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-sys\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-wtmp\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-root\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782936 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e7756f7-a36b-49be-887c-ab6356227b77-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.782966 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e7756f7-a36b-49be-887c-ab6356227b77-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.783023 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.783004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-tls\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.783471 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.783039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.783471 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:56.783045 2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 18:05:56.783471 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.783073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-accelerators-collector-config\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.783471 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:56.783131 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-tls podName:54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:57.283106723 +0000 UTC m=+57.932261348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-tqn76" (UID: "54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606") : secret "openshift-state-metrics-tls" not found Jul 09 18:05:56.783471 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.783175 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.783730 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.783651 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.785876 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.785854 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.785876 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.785873 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.797694 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.797673 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkfhb\" (UniqueName: \"kubernetes.io/projected/8e7756f7-a36b-49be-887c-ab6356227b77-kube-api-access-wkfhb\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:56.797801 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.797784 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gql2\" (UniqueName: \"kubernetes.io/projected/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-kube-api-access-2gql2\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:56.883726 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883652 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-sys\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883726 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-wtmp\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-root\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883760 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-sys\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-tls\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-accelerators-collector-config\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883861 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-root\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:56.883883 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrg8b\" (UniqueName: \"kubernetes.io/projected/722ecfba-1de0-4e94-a306-577a58500178-kube-api-access-wrg8b\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.883913 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.883899 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-wtmp\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.884308 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:05:56.883946 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-tls podName:722ecfba-1de0-4e94-a306-577a58500178 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:57.383928045 +0000 UTC m=+58.033082671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-tls") pod "node-exporter-blfvg" (UID: "722ecfba-1de0-4e94-a306-577a58500178") : secret "node-exporter-tls" not found Jul 09 18:05:56.884308 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.884071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-textfile\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.884308 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.884107 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/722ecfba-1de0-4e94-a306-577a58500178-metrics-client-ca\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.884536 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.884368 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-accelerators-collector-config\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.884536 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.884372 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-textfile\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.884680 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.884659 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/722ecfba-1de0-4e94-a306-577a58500178-metrics-client-ca\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.886005 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.885989 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:56.893021 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:56.892995 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrg8b\" (UniqueName: \"kubernetes.io/projected/722ecfba-1de0-4e94-a306-577a58500178-kube-api-access-wrg8b\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:57.288362 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.288321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:57.288755 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.288420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:57.290822 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.290794 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tqn76\" (UID: \"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:57.290822 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.290800 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e7756f7-a36b-49be-887c-ab6356227b77-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zr7p\" (UID: \"8e7756f7-a36b-49be-887c-ab6356227b77\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:57.389673 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.389637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-tls\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:57.392187 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.392161 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/722ecfba-1de0-4e94-a306-577a58500178-node-exporter-tls\") pod \"node-exporter-blfvg\" (UID: \"722ecfba-1de0-4e94-a306-577a58500178\") " pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:57.533778 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.533733 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" Jul 09 18:05:57.543217 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.543162 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" Jul 09 18:05:57.574095 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.574060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-blfvg" Jul 09 18:05:57.585066 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:57.585011 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722ecfba_1de0_4e94_a306_577a58500178.slice/crio-123e542093c0c15ea56b5cdd666c20ef38dca63777678835e3419de9516feadb WatchSource:0}: Error finding container 123e542093c0c15ea56b5cdd666c20ef38dca63777678835e3419de9516feadb: Status 404 returned error can't find the container with id 123e542093c0c15ea56b5cdd666c20ef38dca63777678835e3419de9516feadb Jul 09 18:05:57.670697 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.670647 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76"] Jul 09 18:05:57.673338 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.673312 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:05:57.673943 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:57.673897 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e9c8d5_65c6_4ba9_a2cc_e2ca6ed81606.slice/crio-d746e4a4ed245b988d18fd7724f86776ea65ffa4b422034c5d80a2843da9d7c1 WatchSource:0}: Error finding container d746e4a4ed245b988d18fd7724f86776ea65ffa4b422034c5d80a2843da9d7c1: Status 404 returned error can't find the container with id d746e4a4ed245b988d18fd7724f86776ea65ffa4b422034c5d80a2843da9d7c1 Jul 09 18:05:57.677627 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.677610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.680077 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680046 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 18:05:57.680149 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680053 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 18:05:57.680507 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680490 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 18:05:57.680589 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680555 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 18:05:57.680589 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680558 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 18:05:57.680680 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680589 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mnp6z\"" Jul 09 18:05:57.680680 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680592 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 18:05:57.680880 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680867 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 18:05:57.680961 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.680883 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 18:05:57.681227 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.681207 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 18:05:57.691276 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.691252 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:05:57.694816 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.694792 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4zr7p"] Jul 09 18:05:57.704503 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:57.704477 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7756f7_a36b_49be_887c_ab6356227b77.slice/crio-6848525336d7f06c6c3943a45578b3f16ab0d228afbbcbab92d4b35c5d5c9796 WatchSource:0}: Error finding container 6848525336d7f06c6c3943a45578b3f16ab0d228afbbcbab92d4b35c5d5c9796: Status 404 returned error can't find the container with id 6848525336d7f06c6c3943a45578b3f16ab0d228afbbcbab92d4b35c5d5c9796 Jul 09 18:05:57.792869 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.792838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-out\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.792998 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.792879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.792998 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.792911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.792998 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.792989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793165 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793021 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plfv7\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-kube-api-access-plfv7\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793165 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793165 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793133 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793346 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-volume\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793346 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793346 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.793346 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.795573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-web-config\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.795573 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.793375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plfv7\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-kube-api-access-plfv7\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895818 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895818 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895891 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-volume\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895891 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.895891 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896051 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896051 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-web-config\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896051 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896051 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.895998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-out\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896051 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.896029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896274 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.896060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896411 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.896384 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.896611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.896588 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.897269 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.896919 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.898868 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.898675 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.898977 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.898873 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-volume\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.898977 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.898886 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.898977 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.898905 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.898977 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.898946 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.898977 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.898952 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-out\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.899212 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.899196 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.899579 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.899556 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.900659 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.900640 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-web-config\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.903378 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.903359 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plfv7\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-kube-api-access-plfv7\") pod \"alertmanager-main-0\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:57.989444 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:57.989403 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:05:58.121605 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.121573 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:05:58.126126 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:58.126097 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf75e364e_34db_44f4_8a32_5f6313b32e6f.slice/crio-2970f66901b502a18b6e31b9c894e7c4c719483f8fb8067b5df217fa86af11e1 WatchSource:0}: Error finding container 2970f66901b502a18b6e31b9c894e7c4c719483f8fb8067b5df217fa86af11e1: Status 404 returned error can't find the container with id 2970f66901b502a18b6e31b9c894e7c4c719483f8fb8067b5df217fa86af11e1 Jul 09 18:05:58.268338 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.268298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"2970f66901b502a18b6e31b9c894e7c4c719483f8fb8067b5df217fa86af11e1"} Jul 09 18:05:58.269670 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.269643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blfvg" event={"ID":"722ecfba-1de0-4e94-a306-577a58500178","Type":"ContainerStarted","Data":"123e542093c0c15ea56b5cdd666c20ef38dca63777678835e3419de9516feadb"} Jul 09 18:05:58.271672 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.271640 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" event={"ID":"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606","Type":"ContainerStarted","Data":"b94334c2a4ab5230f0765b0e3cfed2fe4efb2590b8d30287231bef24309b6dc1"} Jul 09 18:05:58.271774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.271699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" event={"ID":"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606","Type":"ContainerStarted","Data":"55d6c9ec8a424ed1ea8479289ea2bb9379c5734514dbc47880e18fa5fe32ecc1"} Jul 09 18:05:58.271774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.271728 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" event={"ID":"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606","Type":"ContainerStarted","Data":"d746e4a4ed245b988d18fd7724f86776ea65ffa4b422034c5d80a2843da9d7c1"} Jul 09 18:05:58.272893 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.272871 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" event={"ID":"8e7756f7-a36b-49be-887c-ab6356227b77","Type":"ContainerStarted","Data":"6848525336d7f06c6c3943a45578b3f16ab0d228afbbcbab92d4b35c5d5c9796"} Jul 09 18:05:58.725873 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.725842 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-df55bf5b-l8scg"] Jul 09 18:05:58.728925 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.728902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.732888 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.732293 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 18:05:58.732888 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.732571 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 18:05:58.732888 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.732585 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-el2spfiuckk00\"" Jul 09 18:05:58.732888 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.732781 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 18:05:58.734419 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.733984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 18:05:58.734419 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.734124 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2687w\"" Jul 09 18:05:58.734419 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.734249 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 18:05:58.743841 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.743818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-df55bf5b-l8scg"] Jul 09 18:05:58.803359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gz6\" (UniqueName: \"kubernetes.io/projected/9c6b325a-57d8-479b-a8ce-f577d939aa3b-kube-api-access-26gz6\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c6b325a-57d8-479b-a8ce-f577d939aa3b-metrics-client-ca\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-grpc-tls\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803692 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-tls\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803692 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803692 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.803692 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.803503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.904886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.904802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-grpc-tls\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.904886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.904850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.904890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-tls\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.904923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.904948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.904967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.905009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gz6\" (UniqueName: \"kubernetes.io/projected/9c6b325a-57d8-479b-a8ce-f577d939aa3b-kube-api-access-26gz6\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905114 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.905057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c6b325a-57d8-479b-a8ce-f577d939aa3b-metrics-client-ca\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.905856 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.905825 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c6b325a-57d8-479b-a8ce-f577d939aa3b-metrics-client-ca\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.909897 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.909850 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-grpc-tls\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.909897 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.909890 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.910061 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.909941 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.911517 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.911474 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-tls\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.911690 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.911667 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.914026 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.913999 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c6b325a-57d8-479b-a8ce-f577d939aa3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:58.915614 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:58.915590 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gz6\" (UniqueName: \"kubernetes.io/projected/9c6b325a-57d8-479b-a8ce-f577d939aa3b-kube-api-access-26gz6\") pod \"thanos-querier-df55bf5b-l8scg\" (UID: \"9c6b325a-57d8-479b-a8ce-f577d939aa3b\") " pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:59.043238 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:59.043165 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:05:59.277660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:59.277628 2573 generic.go:356] "Generic (PLEG): container finished" podID="722ecfba-1de0-4e94-a306-577a58500178" containerID="906f904b520ff037b82098b32cf973147464fa7c23f13f9a0a2b34c6e1422fa5" exitCode=0 Jul 09 18:05:59.277818 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:59.277675 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blfvg" event={"ID":"722ecfba-1de0-4e94-a306-577a58500178","Type":"ContainerDied","Data":"906f904b520ff037b82098b32cf973147464fa7c23f13f9a0a2b34c6e1422fa5"} Jul 09 18:05:59.464135 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:05:59.463590 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-df55bf5b-l8scg"] Jul 09 18:05:59.469070 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:05:59.469045 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6b325a_57d8_479b_a8ce_f577d939aa3b.slice/crio-34f45a56ee457de43a5f1d1bc0f33e9a751095458f75dbe9593bc47c0839cb76 WatchSource:0}: Error finding container 34f45a56ee457de43a5f1d1bc0f33e9a751095458f75dbe9593bc47c0839cb76: Status 404 returned error can't find the container with id 34f45a56ee457de43a5f1d1bc0f33e9a751095458f75dbe9593bc47c0839cb76 Jul 09 18:06:00.286807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.286496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blfvg" event={"ID":"722ecfba-1de0-4e94-a306-577a58500178","Type":"ContainerStarted","Data":"6b55125a5d0ff0435cdabdfb473ca1b4625f7f6f6c41200aad64d51745476975"} Jul 09 18:06:00.286807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.286567 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blfvg" event={"ID":"722ecfba-1de0-4e94-a306-577a58500178","Type":"ContainerStarted","Data":"b2f9ca45f0733d6dae8e0b7295ad9eb2236f321cc78632f5b04f2fd632049756"} Jul 09 18:06:00.289272 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.289243 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" event={"ID":"54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606","Type":"ContainerStarted","Data":"c6427e9b166fa0fc16150529b4877b82c17a20a969b8b5c64fc16aec5cc6fa17"} Jul 09 18:06:00.290498 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.290471 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"34f45a56ee457de43a5f1d1bc0f33e9a751095458f75dbe9593bc47c0839cb76"} Jul 09 18:06:00.292559 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.292537 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" event={"ID":"8e7756f7-a36b-49be-887c-ab6356227b77","Type":"ContainerStarted","Data":"f21797e91a3f207bca03b4a6753f40e43915e25a93e743b2e06a2e3187e73360"} Jul 09 18:06:00.292677 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.292587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" event={"ID":"8e7756f7-a36b-49be-887c-ab6356227b77","Type":"ContainerStarted","Data":"fb517d97007c952cc795886e38b571f5b5b567084530f743d78a9e448165b553"} Jul 09 18:06:00.292677 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.292619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" event={"ID":"8e7756f7-a36b-49be-887c-ab6356227b77","Type":"ContainerStarted","Data":"ebdb8c4fcbddff470efca2b866efa9adbf8e7d957f8006fc46ea4ab86977cd06"} Jul 09 18:06:00.308205 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.308158 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-blfvg" podStartSLOduration=3.210399001 podStartE2EDuration="4.308144842s" totalImagesPullingTime="1.023297038s" totalInitContainerRuntime="74.448803ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:00.307585781 +0000 UTC m=+60.956740448" watchObservedRunningTime="2026-07-09 18:06:00.308144842 +0000 UTC m=+60.957299466" Jul 09 18:06:00.327309 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.327249 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tqn76" podStartSLOduration=2.784469864 podStartE2EDuration="4.327237979s" totalImagesPullingTime="1.542768115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:00.325975525 +0000 UTC m=+60.975130193" watchObservedRunningTime="2026-07-09 18:06:00.327237979 +0000 UTC m=+60.976392625" Jul 09 18:06:00.347014 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.346966 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zr7p" podStartSLOduration=2.735402648 podStartE2EDuration="4.34694582s" totalImagesPullingTime="1.611543172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:00.345928275 +0000 UTC m=+60.995082946" watchObservedRunningTime="2026-07-09 18:06:00.34694582 +0000 UTC m=+60.996100467" Jul 09 18:06:00.962945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.962910 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fdb467dc8-6nll6"] Jul 09 18:06:00.985295 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.985257 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fdb467dc8-6nll6"] Jul 09 18:06:00.985479 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.985406 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:00.989571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.989363 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hb6x7\"" Jul 09 18:06:00.989571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.989402 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5gcj9d9nb9i27\"" Jul 09 18:06:00.989571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.989407 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 18:06:00.989571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.989492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 18:06:00.989571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.989372 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 18:06:00.990119 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:00.989747 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 18:06:01.024371 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-secret-metrics-server-tls\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.024559 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/54d72537-2f32-4d57-8a4e-b86519dc0d72-audit-log\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.024559 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-secret-metrics-server-client-certs\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.024559 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxbrr\" (UniqueName: \"kubernetes.io/projected/54d72537-2f32-4d57-8a4e-b86519dc0d72-kube-api-access-zxbrr\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.024559 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-client-ca-bundle\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.024772 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/54d72537-2f32-4d57-8a4e-b86519dc0d72-metrics-server-audit-profiles\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.024772 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.024675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d72537-2f32-4d57-8a4e-b86519dc0d72-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125392 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125354 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/54d72537-2f32-4d57-8a4e-b86519dc0d72-metrics-server-audit-profiles\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125555 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d72537-2f32-4d57-8a4e-b86519dc0d72-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125555 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-secret-metrics-server-tls\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125555 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125500 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/54d72537-2f32-4d57-8a4e-b86519dc0d72-audit-log\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125555 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-secret-metrics-server-client-certs\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxbrr\" (UniqueName: \"kubernetes.io/projected/54d72537-2f32-4d57-8a4e-b86519dc0d72-kube-api-access-zxbrr\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.125760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.125591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-client-ca-bundle\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.126091 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.126070 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/54d72537-2f32-4d57-8a4e-b86519dc0d72-audit-log\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.126177 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.126167 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d72537-2f32-4d57-8a4e-b86519dc0d72-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.126611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.126584 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/54d72537-2f32-4d57-8a4e-b86519dc0d72-metrics-server-audit-profiles\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.128293 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.128265 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-secret-metrics-server-client-certs\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.128584 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.128567 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-client-ca-bundle\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.128655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.128604 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/54d72537-2f32-4d57-8a4e-b86519dc0d72-secret-metrics-server-tls\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.133900 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.133881 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxbrr\" (UniqueName: \"kubernetes.io/projected/54d72537-2f32-4d57-8a4e-b86519dc0d72-kube-api-access-zxbrr\") pod \"metrics-server-6fdb467dc8-6nll6\" (UID: \"54d72537-2f32-4d57-8a4e-b86519dc0d72\") " pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.295798 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.295720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:01.393996 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.393958 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6"] Jul 09 18:06:01.396331 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.396310 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.398864 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.398846 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qzxn2\"" Jul 09 18:06:01.398980 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.398908 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 18:06:01.407087 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.407050 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6"] Jul 09 18:06:01.529739 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.529706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhs55\" (UniqueName: \"kubernetes.io/projected/6329b008-cf4f-4373-9467-ebbc0991e5e9-kube-api-access-zhs55\") pod \"monitoring-plugin-5f68df7f58-bbdv6\" (UID: \"6329b008-cf4f-4373-9467-ebbc0991e5e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.529931 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.529829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6329b008-cf4f-4373-9467-ebbc0991e5e9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bbdv6\" (UID: \"6329b008-cf4f-4373-9467-ebbc0991e5e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.631296 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.631221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhs55\" (UniqueName: \"kubernetes.io/projected/6329b008-cf4f-4373-9467-ebbc0991e5e9-kube-api-access-zhs55\") pod \"monitoring-plugin-5f68df7f58-bbdv6\" (UID: \"6329b008-cf4f-4373-9467-ebbc0991e5e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.631476 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.631340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6329b008-cf4f-4373-9467-ebbc0991e5e9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bbdv6\" (UID: \"6329b008-cf4f-4373-9467-ebbc0991e5e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.633546 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.633520 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6329b008-cf4f-4373-9467-ebbc0991e5e9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bbdv6\" (UID: \"6329b008-cf4f-4373-9467-ebbc0991e5e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.639256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.639231 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhs55\" (UniqueName: \"kubernetes.io/projected/6329b008-cf4f-4373-9467-ebbc0991e5e9-kube-api-access-zhs55\") pod \"monitoring-plugin-5f68df7f58-bbdv6\" (UID: \"6329b008-cf4f-4373-9467-ebbc0991e5e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.707675 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.707650 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:01.825988 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.825813 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fdb467dc8-6nll6"] Jul 09 18:06:01.840407 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:01.840381 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d72537_2f32_4d57_8a4e_b86519dc0d72.slice/crio-d9cc007d64e4cfd0d091aca4a041355b7682858b98e15b798719b001035099c6 WatchSource:0}: Error finding container d9cc007d64e4cfd0d091aca4a041355b7682858b98e15b798719b001035099c6: Status 404 returned error can't find the container with id d9cc007d64e4cfd0d091aca4a041355b7682858b98e15b798719b001035099c6 Jul 09 18:06:01.855785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:01.855759 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6"] Jul 09 18:06:01.858921 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:01.858895 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6329b008_cf4f_4373_9467_ebbc0991e5e9.slice/crio-6fac7613ab3310a366c804fb6ad263e2dd41f6fcaab0546ff14282f1d7976350 WatchSource:0}: Error finding container 6fac7613ab3310a366c804fb6ad263e2dd41f6fcaab0546ff14282f1d7976350: Status 404 returned error can't find the container with id 6fac7613ab3310a366c804fb6ad263e2dd41f6fcaab0546ff14282f1d7976350 Jul 09 18:06:02.163695 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.163608 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7s8z" Jul 09 18:06:02.302842 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.302809 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"56496300f7d37b861999b7109b93810de737cd34ad479b3babbdd173aa551132"} Jul 09 18:06:02.303213 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.302903 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"226d59d972650de7526811a8c270a2d11486efd016220977370b96ac450c1e89"} Jul 09 18:06:02.303213 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.302948 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"87e91ad7e5c84834c425f92f1613517decd663e7c7619e90daf1a549b366203c"} Jul 09 18:06:02.303996 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.303968 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" event={"ID":"6329b008-cf4f-4373-9467-ebbc0991e5e9","Type":"ContainerStarted","Data":"6fac7613ab3310a366c804fb6ad263e2dd41f6fcaab0546ff14282f1d7976350"} Jul 09 18:06:02.305154 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.305131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" event={"ID":"54d72537-2f32-4d57-8a4e-b86519dc0d72","Type":"ContainerStarted","Data":"d9cc007d64e4cfd0d091aca4a041355b7682858b98e15b798719b001035099c6"} Jul 09 18:06:02.306541 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.306512 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f" exitCode=0 Jul 09 18:06:02.306636 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.306549 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f"} Jul 09 18:06:02.502152 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.501430 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5755899d96-b62xh"] Jul 09 18:06:02.533659 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.533621 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d6b7d5d7c-8bwtw"] Jul 09 18:06:02.539384 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.538304 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.547365 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.546999 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6b7d5d7c-8bwtw"] Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-serving-cert\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-oauth-config\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-trusted-ca-bundle\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbbdf\" (UniqueName: \"kubernetes.io/projected/a9805ec1-141d-4cbd-9012-ee7d2d271423-kube-api-access-kbbdf\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-oauth-serving-cert\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-config\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.643791 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.640793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-service-ca\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741412 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-trusted-ca-bundle\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741412 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbbdf\" (UniqueName: \"kubernetes.io/projected/a9805ec1-141d-4cbd-9012-ee7d2d271423-kube-api-access-kbbdf\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741684 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-oauth-serving-cert\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741684 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-config\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741684 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-service-ca\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741684 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-serving-cert\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.741897 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.741694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-oauth-config\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.744388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.743071 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-trusted-ca-bundle\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.744388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.743992 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-oauth-serving-cert\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.744388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.744098 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-service-ca\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.744744 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.744722 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-config\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.744803 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.744774 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-oauth-config\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.746662 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.746621 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-serving-cert\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.753720 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.753640 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbbdf\" (UniqueName: \"kubernetes.io/projected/a9805ec1-141d-4cbd-9012-ee7d2d271423-kube-api-access-kbbdf\") pod \"console-5d6b7d5d7c-8bwtw\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.850789 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.850670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:02.925243 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.924209 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:06:02.929367 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.929288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.932955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.932993 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933046 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.932998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933334 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933350 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b99zg\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933385 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e6oe3a2meskn5\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933335 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933542 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933559 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933667 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 18:06:02.933858 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.933387 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 18:06:02.934693 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.934674 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 18:06:02.934834 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.934816 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 18:06:02.935031 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.935004 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 18:06:02.937303 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.937281 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 18:06:02.941848 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:02.941828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:06:03.044792 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.044792 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.044792 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.044792 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.044792 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044705 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.044991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-config\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045050 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045161 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045738 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045208 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7cr\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-kube-api-access-6v7cr\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045738 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.045738 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.045258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.146857 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.146808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147056 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.146886 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147056 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.146930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147056 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.146981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147056 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147056 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-config\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7cr\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-kube-api-access-6v7cr\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.147829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.148017 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.147995 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.148793 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.148763 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.149393 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.149360 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.150899 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.151005 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.151351 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.151466 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.151876 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.152098 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.152303 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.152420 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.152928 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.152845 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.153388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.153348 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-config\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.154121 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.154083 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.154635 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.154599 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.155758 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.155739 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.155903 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.155880 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.155982 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.155947 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.156493 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.156464 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.158691 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.158668 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7cr\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-kube-api-access-6v7cr\") pod \"prometheus-k8s-0\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.243532 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.243500 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:03.893266 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:03.893229 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6b7d5d7c-8bwtw"] Jul 09 18:06:04.140505 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:04.140469 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9805ec1_141d_4cbd_9012_ee7d2d271423.slice/crio-c3c52c13f1d2fcce86a8b709c02d489dccdf0b9882211c1dffba87739dd6e4a6 WatchSource:0}: Error finding container c3c52c13f1d2fcce86a8b709c02d489dccdf0b9882211c1dffba87739dd6e4a6: Status 404 returned error can't find the container with id c3c52c13f1d2fcce86a8b709c02d489dccdf0b9882211c1dffba87739dd6e4a6 Jul 09 18:06:04.249927 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.249837 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-27zzq" Jul 09 18:06:04.333022 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.332989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" event={"ID":"54d72537-2f32-4d57-8a4e-b86519dc0d72","Type":"ContainerStarted","Data":"56b3114ce3d3f5972c5ad376c31794e747d430a1796bad80edcc0bbb5fa3f67a"} Jul 09 18:06:04.335074 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.335048 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6b7d5d7c-8bwtw" event={"ID":"a9805ec1-141d-4cbd-9012-ee7d2d271423","Type":"ContainerStarted","Data":"e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0"} Jul 09 18:06:04.335166 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.335093 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6b7d5d7c-8bwtw" event={"ID":"a9805ec1-141d-4cbd-9012-ee7d2d271423","Type":"ContainerStarted","Data":"c3c52c13f1d2fcce86a8b709c02d489dccdf0b9882211c1dffba87739dd6e4a6"} Jul 09 18:06:04.338041 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.338017 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0"} Jul 09 18:06:04.340980 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.340955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"35a905fac81f5b7da2407cf20629d24cfa122104b50462cf0f87a05b3d3044ff"} Jul 09 18:06:04.342506 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.342435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" event={"ID":"6329b008-cf4f-4373-9467-ebbc0991e5e9","Type":"ContainerStarted","Data":"94f569c5a34ed4571495e14b60d9024ca96e2e1db6a175a639a024a7b1fd302a"} Jul 09 18:06:04.342781 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.342740 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:04.348685 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.348652 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" Jul 09 18:06:04.351624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.351586 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" podStartSLOduration=2.026328853 podStartE2EDuration="4.351568957s" totalImagesPullingTime="2.325240104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:04.349993934 +0000 UTC m=+64.999148582" watchObservedRunningTime="2026-07-09 18:06:04.351568957 +0000 UTC m=+65.000723606" Jul 09 18:06:04.357181 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.357164 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:06:04.361661 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:04.361635 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6405c7_83b2_4578_b731_16e375abe457.slice/crio-c01076b971b37375e6018bb304b71c087afd4494d84335c91b18c19ffc47ff6c WatchSource:0}: Error finding container c01076b971b37375e6018bb304b71c087afd4494d84335c91b18c19ffc47ff6c: Status 404 returned error can't find the container with id c01076b971b37375e6018bb304b71c087afd4494d84335c91b18c19ffc47ff6c Jul 09 18:06:04.366549 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.366472 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bbdv6" podStartSLOduration=1.061297458 podStartE2EDuration="3.366440027s" totalImagesPullingTime="2.305142569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:04.36580845 +0000 UTC m=+65.014963114" watchObservedRunningTime="2026-07-09 18:06:04.366440027 +0000 UTC m=+65.015594675" Jul 09 18:06:04.385347 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:04.385100 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d6b7d5d7c-8bwtw" podStartSLOduration=2.385078709 podStartE2EDuration="2.385078709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:04.383633292 +0000 UTC m=+65.032787940" watchObservedRunningTime="2026-07-09 18:06:04.385078709 +0000 UTC m=+65.034233356" Jul 09 18:06:05.011748 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.011702 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:06:05.350235 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.350135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5"} Jul 09 18:06:05.350235 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.350207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f"} Jul 09 18:06:05.350420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.350255 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a"} Jul 09 18:06:05.350420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.350294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee"} Jul 09 18:06:05.350420 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.350328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerStarted","Data":"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8"} Jul 09 18:06:05.353146 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.353122 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"c6b99977c4b4609fc04729e8024bb03bb789027fce191360b736324915557f11"} Jul 09 18:06:05.353256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.353173 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" event={"ID":"9c6b325a-57d8-479b-a8ce-f577d939aa3b","Type":"ContainerStarted","Data":"931972ce4687baaddedc6e95c933a3b20aac05c0cdc52c18b64a6027e147a910"} Jul 09 18:06:05.353256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.353220 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:06:05.354582 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.354556 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" exitCode=0 Jul 09 18:06:05.354753 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.354648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} Jul 09 18:06:05.354753 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.354705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"c01076b971b37375e6018bb304b71c087afd4494d84335c91b18c19ffc47ff6c"} Jul 09 18:06:05.380810 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.380772 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.934713556 podStartE2EDuration="8.380757926s" totalImagesPullingTime="5.416056669s" totalInitContainerRuntime="29.987701ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:05.379440119 +0000 UTC m=+66.028594785" watchObservedRunningTime="2026-07-09 18:06:05.380757926 +0000 UTC m=+66.029912572" Jul 09 18:06:05.433925 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.433866 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" podStartSLOduration=3.026018454 podStartE2EDuration="7.433845111s" totalImagesPullingTime="4.407826657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:05.432960595 +0000 UTC m=+66.082115266" watchObservedRunningTime="2026-07-09 18:06:05.433845111 +0000 UTC m=+66.082999757" Jul 09 18:06:05.678789 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.678747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:06:05.678959 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.678816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:06:05.681835 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.681811 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 18:06:05.681948 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.681811 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 18:06:05.691486 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.691438 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e420c6-bf61-46ff-a147-9b5b653a237a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6fn\" (UID: \"69e420c6-bf61-46ff-a147-9b5b653a237a\") " pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:06:05.691578 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.691543 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc406faa-9889-40ca-8c35-9b70d78bc8ca-metrics-certs\") pod \"network-metrics-daemon-7qkqj\" (UID: \"bc406faa-9889-40ca-8c35-9b70d78bc8ca\") " pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:06:05.780209 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.780167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:06:05.783262 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.783242 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 18:06:05.793106 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.793088 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 18:06:05.803769 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.803746 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8kdr\" (UniqueName: \"kubernetes.io/projected/a421478f-4388-4cbe-aada-bc3f0e638fec-kube-api-access-k8kdr\") pod \"network-check-target-p2j48\" (UID: \"a421478f-4388-4cbe-aada-bc3f0e638fec\") " pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:06:05.912268 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.912240 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkf52\"" Jul 09 18:06:05.917751 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.917729 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6mch4\"" Jul 09 18:06:05.919820 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.919804 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6fn" Jul 09 18:06:05.920838 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.920820 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qkqj" Jul 09 18:06:05.925540 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:05.925527 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:06:06.084602 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.084569 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hz6fn"] Jul 09 18:06:06.087813 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:06.087792 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e420c6_bf61_46ff_a147_9b5b653a237a.slice/crio-78180001f743fb0d6e321fe8dfdd58126f3f6ac17f907d352610dc416b62ac98 WatchSource:0}: Error finding container 78180001f743fb0d6e321fe8dfdd58126f3f6ac17f907d352610dc416b62ac98: Status 404 returned error can't find the container with id 78180001f743fb0d6e321fe8dfdd58126f3f6ac17f907d352610dc416b62ac98 Jul 09 18:06:06.297763 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.297717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7qkqj"] Jul 09 18:06:06.300432 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:06.300396 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc406faa_9889_40ca_8c35_9b70d78bc8ca.slice/crio-4cac60d5896990d3615525c8bb0e570768d56114e93f170cfd8217f5196f1542 WatchSource:0}: Error finding container 4cac60d5896990d3615525c8bb0e570768d56114e93f170cfd8217f5196f1542: Status 404 returned error can't find the container with id 4cac60d5896990d3615525c8bb0e570768d56114e93f170cfd8217f5196f1542 Jul 09 18:06:06.301120 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.301045 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2j48"] Jul 09 18:06:06.303540 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:06:06.303376 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda421478f_4388_4cbe_aada_bc3f0e638fec.slice/crio-7a454b6d72ed1a2cd6e9123f110dd7d7a5fd5dbe287ee2c58adfee1a01258552 WatchSource:0}: Error finding container 7a454b6d72ed1a2cd6e9123f110dd7d7a5fd5dbe287ee2c58adfee1a01258552: Status 404 returned error can't find the container with id 7a454b6d72ed1a2cd6e9123f110dd7d7a5fd5dbe287ee2c58adfee1a01258552 Jul 09 18:06:06.361544 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.361508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hz6fn" event={"ID":"69e420c6-bf61-46ff-a147-9b5b653a237a","Type":"ContainerStarted","Data":"78180001f743fb0d6e321fe8dfdd58126f3f6ac17f907d352610dc416b62ac98"} Jul 09 18:06:06.362848 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.362806 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qkqj" event={"ID":"bc406faa-9889-40ca-8c35-9b70d78bc8ca","Type":"ContainerStarted","Data":"4cac60d5896990d3615525c8bb0e570768d56114e93f170cfd8217f5196f1542"} Jul 09 18:06:06.364100 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.364041 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2j48" event={"ID":"a421478f-4388-4cbe-aada-bc3f0e638fec","Type":"ContainerStarted","Data":"7a454b6d72ed1a2cd6e9123f110dd7d7a5fd5dbe287ee2c58adfee1a01258552"} Jul 09 18:06:06.370464 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:06.370425 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-df55bf5b-l8scg" Jul 09 18:06:08.380830 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:08.380735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qkqj" event={"ID":"bc406faa-9889-40ca-8c35-9b70d78bc8ca","Type":"ContainerStarted","Data":"bf09fa04c87a4b51148b92f9477bd8745fd587ec3846499372769ba63d051585"} Jul 09 18:06:08.380830 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:08.380806 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qkqj" event={"ID":"bc406faa-9889-40ca-8c35-9b70d78bc8ca","Type":"ContainerStarted","Data":"499efa2b2909c4de0684a8d569ac47ae52f883db0be471ec7e4df68046eaf976"} Jul 09 18:06:08.400623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:08.400465 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7qkqj" podStartSLOduration=66.844586523 podStartE2EDuration="1m8.400432996s" totalImagesPullingTime="1.555846473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:08.399083829 +0000 UTC m=+69.048238508" watchObservedRunningTime="2026-07-09 18:06:08.400432996 +0000 UTC m=+69.049587643" Jul 09 18:06:12.399575 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.399540 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2j48" event={"ID":"a421478f-4388-4cbe-aada-bc3f0e638fec","Type":"ContainerStarted","Data":"2029cc03fa07f10c2d528809a36bed2a4f743537f9aefe53bffc20de3984d6c0"} Jul 09 18:06:12.399956 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.399660 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:06:12.401188 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.401161 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hz6fn" event={"ID":"69e420c6-bf61-46ff-a147-9b5b653a237a","Type":"ContainerStarted","Data":"d89f24eec38fe75a6860e593ccf6299f87a4b20e8282b9c86bc87396eaeac515"} Jul 09 18:06:12.404388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.404369 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} Jul 09 18:06:12.404486 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.404418 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} Jul 09 18:06:12.404486 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.404444 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} Jul 09 18:06:12.404575 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.404486 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} Jul 09 18:06:12.404575 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.404512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} Jul 09 18:06:12.404575 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.404540 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerStarted","Data":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} Jul 09 18:06:12.417695 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.417646 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p2j48" podStartSLOduration=66.776488896 podStartE2EDuration="1m12.417629597s" totalImagesPullingTime="5.641140701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:12.414990288 +0000 UTC m=+73.064144960" watchObservedRunningTime="2026-07-09 18:06:12.417629597 +0000 UTC m=+73.066784246" Jul 09 18:06:12.446057 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.445960 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.8377930940000002 podStartE2EDuration="10.445941799s" totalImagesPullingTime="6.58356594s" totalInitContainerRuntime="24.582765ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:12.443488585 +0000 UTC m=+73.092643267" watchObservedRunningTime="2026-07-09 18:06:12.445941799 +0000 UTC m=+73.095096447" Jul 09 18:06:12.460106 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.460066 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hz6fn" podStartSLOduration=66.593294026 podStartE2EDuration="1m12.460054105s" totalImagesPullingTime="5.866760079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:12.458893249 +0000 UTC m=+73.108047905" watchObservedRunningTime="2026-07-09 18:06:12.460054105 +0000 UTC m=+73.109208751" Jul 09 18:06:12.851537 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.851418 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:12.851537 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.851533 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:12.856334 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:12.856313 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:13.244232 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:13.244199 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:06:13.411540 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:13.411514 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:06:13.457779 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:13.457742 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f857895dd-6jnm4"] Jul 09 18:06:21.296795 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:21.296685 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:21.296795 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:21.296743 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:27.539716 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.539657 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5755899d96-b62xh" podUID="402cc5c9-84f8-4014-ba8f-9ded88b28edc" containerName="console" containerID="cri-o://f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b" gracePeriod=15 Jul 09 18:06:27.781582 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.781559 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:06:27.791566 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791514 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-config\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791566 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791560 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-oauth-serving-cert\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791727 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791606 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7dhs\" (UniqueName: \"kubernetes.io/projected/402cc5c9-84f8-4014-ba8f-9ded88b28edc-kube-api-access-z7dhs\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791727 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791660 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-service-ca\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791727 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791721 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-trusted-ca-bundle\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791757 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-oauth-config\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791828 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-serving-cert\") pod \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\" (UID: \"402cc5c9-84f8-4014-ba8f-9ded88b28edc\") " Jul 09 18:06:27.791986 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.791878 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-config" (OuterVolumeSpecName: "console-config") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:27.792073 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.792050 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:27.792135 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.792068 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-service-ca" (OuterVolumeSpecName: "service-ca") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:27.792135 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.792127 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:27.792237 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.792199 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:27.793885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.793859 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:06:27.793979 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.793900 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402cc5c9-84f8-4014-ba8f-9ded88b28edc-kube-api-access-z7dhs" (OuterVolumeSpecName: "kube-api-access-z7dhs") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "kube-api-access-z7dhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:06:27.793979 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.793903 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "402cc5c9-84f8-4014-ba8f-9ded88b28edc" (UID: "402cc5c9-84f8-4014-ba8f-9ded88b28edc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:06:27.892714 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.892684 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7dhs\" (UniqueName: \"kubernetes.io/projected/402cc5c9-84f8-4014-ba8f-9ded88b28edc-kube-api-access-z7dhs\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:27.892714 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.892711 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:27.892714 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.892722 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:27.892943 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.892731 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:27.892943 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.892739 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402cc5c9-84f8-4014-ba8f-9ded88b28edc-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:27.892943 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:27.892748 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402cc5c9-84f8-4014-ba8f-9ded88b28edc-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:28.468885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.468850 2573 generic.go:356] "Generic (PLEG): container finished" podID="402cc5c9-84f8-4014-ba8f-9ded88b28edc" containerID="f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b" exitCode=0 Jul 09 18:06:28.469055 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.468899 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755899d96-b62xh" Jul 09 18:06:28.469055 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.468936 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755899d96-b62xh" event={"ID":"402cc5c9-84f8-4014-ba8f-9ded88b28edc","Type":"ContainerDied","Data":"f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b"} Jul 09 18:06:28.469055 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.468987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755899d96-b62xh" event={"ID":"402cc5c9-84f8-4014-ba8f-9ded88b28edc","Type":"ContainerDied","Data":"6b3a29e7f9c01d646f04932d6e0575f650bea960cc13ff834f09a1725bc7df72"} Jul 09 18:06:28.469055 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.469006 2573 scope.go:117] "RemoveContainer" containerID="f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b" Jul 09 18:06:28.477935 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.477916 2573 scope.go:117] "RemoveContainer" containerID="f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b" Jul 09 18:06:28.478207 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:06:28.478187 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b\": container with ID starting with f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b not found: ID does not exist" containerID="f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b" Jul 09 18:06:28.478258 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.478215 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b"} err="failed to get container status \"f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b\": rpc error: code = NotFound desc = could not find container \"f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b\": container with ID starting with f2ba161df05afa7458f5fb4e00a1cd90b632ed3ae896f8f18ef2aa4b42f2ca3b not found: ID does not exist" Jul 09 18:06:28.485268 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.485243 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5755899d96-b62xh"] Jul 09 18:06:28.491182 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:28.491163 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5755899d96-b62xh"] Jul 09 18:06:30.009766 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:30.009731 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402cc5c9-84f8-4014-ba8f-9ded88b28edc" path="/var/lib/kubelet/pods/402cc5c9-84f8-4014-ba8f-9ded88b28edc/volumes" Jul 09 18:06:38.479224 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.479146 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f857895dd-6jnm4" podUID="da7ba552-86b8-4b8d-9801-4ac804fdcdb0" containerName="console" containerID="cri-o://5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704" gracePeriod=15 Jul 09 18:06:38.750557 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.750494 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:06:38.785803 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.785774 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-oauth-serving-cert\") pod \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " Jul 09 18:06:38.785970 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.785815 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-config\") pod \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " Jul 09 18:06:38.785970 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.785839 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-service-ca\") pod \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " Jul 09 18:06:38.785970 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.785960 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-serving-cert\") pod \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " Jul 09 18:06:38.786127 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786027 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmnfm\" (UniqueName: \"kubernetes.io/projected/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-kube-api-access-nmnfm\") pod \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " Jul 09 18:06:38.786127 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786070 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-oauth-config\") pod \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\" (UID: \"da7ba552-86b8-4b8d-9801-4ac804fdcdb0\") " Jul 09 18:06:38.786290 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786252 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da7ba552-86b8-4b8d-9801-4ac804fdcdb0" (UID: "da7ba552-86b8-4b8d-9801-4ac804fdcdb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:38.786290 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786259 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-config" (OuterVolumeSpecName: "console-config") pod "da7ba552-86b8-4b8d-9801-4ac804fdcdb0" (UID: "da7ba552-86b8-4b8d-9801-4ac804fdcdb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:38.786290 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786265 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "da7ba552-86b8-4b8d-9801-4ac804fdcdb0" (UID: "da7ba552-86b8-4b8d-9801-4ac804fdcdb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:38.786506 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786394 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:38.786506 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786412 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:38.786506 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.786426 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:38.788117 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.788091 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-kube-api-access-nmnfm" (OuterVolumeSpecName: "kube-api-access-nmnfm") pod "da7ba552-86b8-4b8d-9801-4ac804fdcdb0" (UID: "da7ba552-86b8-4b8d-9801-4ac804fdcdb0"). InnerVolumeSpecName "kube-api-access-nmnfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:06:38.788117 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.788103 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da7ba552-86b8-4b8d-9801-4ac804fdcdb0" (UID: "da7ba552-86b8-4b8d-9801-4ac804fdcdb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:06:38.788602 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.788586 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da7ba552-86b8-4b8d-9801-4ac804fdcdb0" (UID: "da7ba552-86b8-4b8d-9801-4ac804fdcdb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:06:38.886826 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.886792 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmnfm\" (UniqueName: \"kubernetes.io/projected/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-kube-api-access-nmnfm\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:38.886826 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.886820 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:38.886826 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:38.886829 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da7ba552-86b8-4b8d-9801-4ac804fdcdb0-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:06:39.514804 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.514769 2573 generic.go:356] "Generic (PLEG): container finished" podID="da7ba552-86b8-4b8d-9801-4ac804fdcdb0" containerID="5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704" exitCode=0 Jul 09 18:06:39.515238 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.514815 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f857895dd-6jnm4" Jul 09 18:06:39.515238 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.514859 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f857895dd-6jnm4" event={"ID":"da7ba552-86b8-4b8d-9801-4ac804fdcdb0","Type":"ContainerDied","Data":"5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704"} Jul 09 18:06:39.515238 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.514920 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f857895dd-6jnm4" event={"ID":"da7ba552-86b8-4b8d-9801-4ac804fdcdb0","Type":"ContainerDied","Data":"e6f3fcfe927aee3a5be0c2d79fbff987ab33174da2f29298982d124e387c9ec4"} Jul 09 18:06:39.515238 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.514952 2573 scope.go:117] "RemoveContainer" containerID="5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704" Jul 09 18:06:39.523263 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.523249 2573 scope.go:117] "RemoveContainer" containerID="5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704" Jul 09 18:06:39.523511 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:06:39.523492 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704\": container with ID starting with 5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704 not found: ID does not exist" containerID="5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704" Jul 09 18:06:39.523565 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.523519 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704"} err="failed to get container status \"5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704\": rpc error: code = NotFound desc = could not find container \"5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704\": container with ID starting with 5530982877c27c2fa8c402872762448a556a2818d47c7ec0e95e3f5ba420a704 not found: ID does not exist" Jul 09 18:06:39.534696 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.534676 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f857895dd-6jnm4"] Jul 09 18:06:39.538835 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:39.538817 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f857895dd-6jnm4"] Jul 09 18:06:40.004126 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:40.004092 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da7ba552-86b8-4b8d-9801-4ac804fdcdb0" path="/var/lib/kubelet/pods/da7ba552-86b8-4b8d-9801-4ac804fdcdb0/volumes" Jul 09 18:06:41.301232 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:41.301203 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:41.305062 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:41.305033 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fdb467dc8-6nll6" Jul 09 18:06:43.409961 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:06:43.409921 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p2j48" Jul 09 18:07:03.243993 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:03.243957 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:03.263508 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:03.263478 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:03.634344 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:03.634260 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:16.946673 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.946632 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:07:16.947240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.947049 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="alertmanager" containerID="cri-o://58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0" gracePeriod=120 Jul 09 18:07:16.947240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.947107 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-metric" containerID="cri-o://fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f" gracePeriod=120 Jul 09 18:07:16.947240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.947136 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-web" containerID="cri-o://d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee" gracePeriod=120 Jul 09 18:07:16.947240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.947156 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy" containerID="cri-o://40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a" gracePeriod=120 Jul 09 18:07:16.947240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.947182 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="prom-label-proxy" containerID="cri-o://687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5" gracePeriod=120 Jul 09 18:07:16.947240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:16.947137 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="config-reloader" containerID="cri-o://8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8" gracePeriod=120 Jul 09 18:07:17.676641 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676607 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5" exitCode=0 Jul 09 18:07:17.676641 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676634 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a" exitCode=0 Jul 09 18:07:17.676641 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676642 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8" exitCode=0 Jul 09 18:07:17.676641 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676647 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0" exitCode=0 Jul 09 18:07:17.676898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5"} Jul 09 18:07:17.676898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a"} Jul 09 18:07:17.676898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676763 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8"} Jul 09 18:07:17.676898 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:17.676787 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0"} Jul 09 18:07:18.193559 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.193535 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.230431 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230402 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-volume\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230471 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-cluster-tls-config\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230507 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-main-db\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230552 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230597 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-out\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230619 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-trusted-ca-bundle\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230648 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230684 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-main-tls\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230711 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plfv7\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-kube-api-access-plfv7\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230767 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-web-config\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230813 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-tls-assets\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.230885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230837 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-metrics-client-ca\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.231179 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.230949 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:18.231867 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.231620 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:18.231867 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.231678 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy\") pod \"f75e364e-34db-44f4-8a32-5f6313b32e6f\" (UID: \"f75e364e-34db-44f4-8a32-5f6313b32e6f\") " Jul 09 18:07:18.232035 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.231951 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-main-db\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.232035 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.231969 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.232635 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.232608 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:18.233654 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.233619 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-volume" (OuterVolumeSpecName: "config-volume") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.237330 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.237258 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:18.237620 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.237577 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.237723 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.237622 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-kube-api-access-plfv7" (OuterVolumeSpecName: "kube-api-access-plfv7") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "kube-api-access-plfv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:18.237787 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.237760 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.238026 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.238003 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.238132 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.238107 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.238321 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.238264 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-out" (OuterVolumeSpecName: "config-out") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:18.242207 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.242184 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.250821 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.250768 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-web-config" (OuterVolumeSpecName: "web-config") pod "f75e364e-34db-44f4-8a32-5f6313b32e6f" (UID: "f75e364e-34db-44f4-8a32-5f6313b32e6f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:18.333029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.332996 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-web-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333024 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-tls-assets\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333032 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e364e-34db-44f4-8a32-5f6313b32e6f-metrics-client-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333042 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333052 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-volume\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333060 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-cluster-tls-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333068 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333077 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e364e-34db-44f4-8a32-5f6313b32e6f-config-out\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333085 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333093 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f75e364e-34db-44f4-8a32-5f6313b32e6f-secret-alertmanager-main-tls\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.333256 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.333101 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plfv7\" (UniqueName: \"kubernetes.io/projected/f75e364e-34db-44f4-8a32-5f6313b32e6f-kube-api-access-plfv7\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:18.683384 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683351 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f" exitCode=0 Jul 09 18:07:18.683384 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683376 2573 generic.go:356] "Generic (PLEG): container finished" podID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerID="d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee" exitCode=0 Jul 09 18:07:18.683619 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683427 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.683619 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f"} Jul 09 18:07:18.683619 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee"} Jul 09 18:07:18.683619 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f75e364e-34db-44f4-8a32-5f6313b32e6f","Type":"ContainerDied","Data":"2970f66901b502a18b6e31b9c894e7c4c719483f8fb8067b5df217fa86af11e1"} Jul 09 18:07:18.683619 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.683604 2573 scope.go:117] "RemoveContainer" containerID="687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5" Jul 09 18:07:18.691119 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.691099 2573 scope.go:117] "RemoveContainer" containerID="fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f" Jul 09 18:07:18.698182 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.698166 2573 scope.go:117] "RemoveContainer" containerID="40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a" Jul 09 18:07:18.707509 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.707484 2573 scope.go:117] "RemoveContainer" containerID="d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee" Jul 09 18:07:18.707612 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.707508 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:07:18.726521 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.711064 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:07:18.732941 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.732898 2573 scope.go:117] "RemoveContainer" containerID="8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8" Jul 09 18:07:18.734958 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.734925 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:07:18.735339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735321 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="config-reloader" Jul 09 18:07:18.735339 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735340 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="config-reloader" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735355 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da7ba552-86b8-4b8d-9801-4ac804fdcdb0" containerName="console" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735360 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da7ba552-86b8-4b8d-9801-4ac804fdcdb0" containerName="console" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735372 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="init-config-reloader" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735377 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="init-config-reloader" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735387 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="alertmanager" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735392 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="alertmanager" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735398 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735403 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735409 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="prom-label-proxy" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735414 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="prom-label-proxy" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735421 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402cc5c9-84f8-4014-ba8f-9ded88b28edc" containerName="console" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735426 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="402cc5c9-84f8-4014-ba8f-9ded88b28edc" containerName="console" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735434 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-web" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735439 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-web" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735464 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-metric" Jul 09 18:07:18.735495 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735471 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-metric" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735530 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da7ba552-86b8-4b8d-9801-4ac804fdcdb0" containerName="console" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735537 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-web" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735543 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="402cc5c9-84f8-4014-ba8f-9ded88b28edc" containerName="console" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735550 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="prom-label-proxy" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735557 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="alertmanager" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735562 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735568 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="config-reloader" Jul 09 18:07:18.736253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.735573 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" containerName="kube-rbac-proxy-metric" Jul 09 18:07:18.740434 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.740416 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.741516 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.741492 2573 scope.go:117] "RemoveContainer" containerID="58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0" Jul 09 18:07:18.742678 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.742660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 18:07:18.742774 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.742758 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 18:07:18.742952 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.742937 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 18:07:18.743106 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.743093 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 18:07:18.743168 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.743152 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 18:07:18.743336 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.743312 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 18:07:18.743406 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.743358 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 18:07:18.743516 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.743499 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 18:07:18.743635 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.743611 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mnp6z\"" Jul 09 18:07:18.750211 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.750188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 18:07:18.755037 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.755012 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:07:18.756390 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.756371 2573 scope.go:117] "RemoveContainer" containerID="42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f" Jul 09 18:07:18.764830 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.764807 2573 scope.go:117] "RemoveContainer" containerID="687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5" Jul 09 18:07:18.765227 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.765201 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5\": container with ID starting with 687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5 not found: ID does not exist" containerID="687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5" Jul 09 18:07:18.765333 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.765240 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5"} err="failed to get container status \"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5\": rpc error: code = NotFound desc = could not find container \"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5\": container with ID starting with 687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5 not found: ID does not exist" Jul 09 18:07:18.765333 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.765302 2573 scope.go:117] "RemoveContainer" containerID="fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f" Jul 09 18:07:18.765853 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.765830 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f\": container with ID starting with fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f not found: ID does not exist" containerID="fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f" Jul 09 18:07:18.765945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.765861 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f"} err="failed to get container status \"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f\": rpc error: code = NotFound desc = could not find container \"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f\": container with ID starting with fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f not found: ID does not exist" Jul 09 18:07:18.765945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.765877 2573 scope.go:117] "RemoveContainer" containerID="40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a" Jul 09 18:07:18.766154 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.766129 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a\": container with ID starting with 40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a not found: ID does not exist" containerID="40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a" Jul 09 18:07:18.766220 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766148 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a"} err="failed to get container status \"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a\": rpc error: code = NotFound desc = could not find container \"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a\": container with ID starting with 40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a not found: ID does not exist" Jul 09 18:07:18.766220 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766166 2573 scope.go:117] "RemoveContainer" containerID="d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee" Jul 09 18:07:18.766410 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.766397 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee\": container with ID starting with d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee not found: ID does not exist" containerID="d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee" Jul 09 18:07:18.766473 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766413 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee"} err="failed to get container status \"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee\": rpc error: code = NotFound desc = could not find container \"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee\": container with ID starting with d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee not found: ID does not exist" Jul 09 18:07:18.766473 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766426 2573 scope.go:117] "RemoveContainer" containerID="8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8" Jul 09 18:07:18.766696 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.766678 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8\": container with ID starting with 8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8 not found: ID does not exist" containerID="8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8" Jul 09 18:07:18.766747 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766701 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8"} err="failed to get container status \"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8\": rpc error: code = NotFound desc = could not find container \"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8\": container with ID starting with 8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8 not found: ID does not exist" Jul 09 18:07:18.766747 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766715 2573 scope.go:117] "RemoveContainer" containerID="58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0" Jul 09 18:07:18.766926 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.766909 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0\": container with ID starting with 58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0 not found: ID does not exist" containerID="58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0" Jul 09 18:07:18.766963 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766940 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0"} err="failed to get container status \"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0\": rpc error: code = NotFound desc = could not find container \"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0\": container with ID starting with 58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0 not found: ID does not exist" Jul 09 18:07:18.766963 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.766952 2573 scope.go:117] "RemoveContainer" containerID="42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f" Jul 09 18:07:18.767209 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:18.767179 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f\": container with ID starting with 42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f not found: ID does not exist" containerID="42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f" Jul 09 18:07:18.767270 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767209 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f"} err="failed to get container status \"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f\": rpc error: code = NotFound desc = could not find container \"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f\": container with ID starting with 42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f not found: ID does not exist" Jul 09 18:07:18.767270 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767225 2573 scope.go:117] "RemoveContainer" containerID="687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5" Jul 09 18:07:18.767441 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767424 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5"} err="failed to get container status \"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5\": rpc error: code = NotFound desc = could not find container \"687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5\": container with ID starting with 687574dda02afcbcdf86274eec80816fd19c4aed0c8c06840ed3528b1a8767d5 not found: ID does not exist" Jul 09 18:07:18.767518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767441 2573 scope.go:117] "RemoveContainer" containerID="fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f" Jul 09 18:07:18.767700 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767681 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f"} err="failed to get container status \"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f\": rpc error: code = NotFound desc = could not find container \"fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f\": container with ID starting with fb2275252f1b3a33534d424e3b1e7ab51174834877a38721cf58137d652def8f not found: ID does not exist" Jul 09 18:07:18.767743 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767701 2573 scope.go:117] "RemoveContainer" containerID="40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a" Jul 09 18:07:18.767911 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767895 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a"} err="failed to get container status \"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a\": rpc error: code = NotFound desc = could not find container \"40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a\": container with ID starting with 40c307088233b83c87ca5c80b84bfd50c71b2f8251e80a52227dbd455e35b07a not found: ID does not exist" Jul 09 18:07:18.767951 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.767912 2573 scope.go:117] "RemoveContainer" containerID="d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee" Jul 09 18:07:18.768122 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768106 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee"} err="failed to get container status \"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee\": rpc error: code = NotFound desc = could not find container \"d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee\": container with ID starting with d792806f7acc87709fc3bd3149f138046978f6a5e97f2ecc2b40cf8211b405ee not found: ID does not exist" Jul 09 18:07:18.768174 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768122 2573 scope.go:117] "RemoveContainer" containerID="8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8" Jul 09 18:07:18.768346 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768325 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8"} err="failed to get container status \"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8\": rpc error: code = NotFound desc = could not find container \"8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8\": container with ID starting with 8388d36609d3720442a70ec824066a992487c8fe14d7fb78db8ffb29c69a94f8 not found: ID does not exist" Jul 09 18:07:18.768416 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768348 2573 scope.go:117] "RemoveContainer" containerID="58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0" Jul 09 18:07:18.768577 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768559 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0"} err="failed to get container status \"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0\": rpc error: code = NotFound desc = could not find container \"58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0\": container with ID starting with 58b6e8f54595d2e4c0d71901188ca088036bf312a96619a263695fd4bc0582d0 not found: ID does not exist" Jul 09 18:07:18.768624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768578 2573 scope.go:117] "RemoveContainer" containerID="42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f" Jul 09 18:07:18.768776 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.768757 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f"} err="failed to get container status \"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f\": rpc error: code = NotFound desc = could not find container \"42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f\": container with ID starting with 42977ab19b551cbfa96aae6b787ce96dcb9ce1ce915fd5b1fc19bfedec24384f not found: ID does not exist" Jul 09 18:07:18.837912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.837878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-config-volume\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.837917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.837939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/376a9448-2ea0-46ea-829c-c7852b75db42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.837978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.837998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376a9448-2ea0-46ea-829c-c7852b75db42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838079 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj92h\" (UniqueName: \"kubernetes.io/projected/376a9448-2ea0-46ea-829c-c7852b75db42-kube-api-access-xj92h\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376a9448-2ea0-46ea-829c-c7852b75db42-config-out\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-web-config\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376a9448-2ea0-46ea-829c-c7852b75db42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.838358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.838166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376a9448-2ea0-46ea-829c-c7852b75db42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939126 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-web-config\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939126 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376a9448-2ea0-46ea-829c-c7852b75db42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939126 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376a9448-2ea0-46ea-829c-c7852b75db42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939369 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-config-volume\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939369 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939369 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/376a9448-2ea0-46ea-829c-c7852b75db42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939369 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939610 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939610 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939610 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376a9448-2ea0-46ea-829c-c7852b75db42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939906 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939906 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939769 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj92h\" (UniqueName: \"kubernetes.io/projected/376a9448-2ea0-46ea-829c-c7852b75db42-kube-api-access-xj92h\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939906 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376a9448-2ea0-46ea-829c-c7852b75db42-config-out\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.939906 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939888 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376a9448-2ea0-46ea-829c-c7852b75db42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.940120 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.939664 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/376a9448-2ea0-46ea-829c-c7852b75db42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942427 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942290 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942427 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942381 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-web-config\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942482 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376a9448-2ea0-46ea-829c-c7852b75db42-config-out\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942495 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376a9448-2ea0-46ea-829c-c7852b75db42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942479 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942537 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-config-volume\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942583 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.942870 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.942662 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.943034 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.943014 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376a9448-2ea0-46ea-829c-c7852b75db42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.944374 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.944356 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/376a9448-2ea0-46ea-829c-c7852b75db42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:18.950820 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:18.950798 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj92h\" (UniqueName: \"kubernetes.io/projected/376a9448-2ea0-46ea-829c-c7852b75db42-kube-api-access-xj92h\") pod \"alertmanager-main-0\" (UID: \"376a9448-2ea0-46ea-829c-c7852b75db42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:19.054769 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:19.054738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 18:07:19.194139 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:19.194059 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 18:07:19.197479 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:07:19.197428 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376a9448_2ea0_46ea_829c_c7852b75db42.slice/crio-7987613d978c9ea60202865e713355e03549210001568978c77da177e1242e77 WatchSource:0}: Error finding container 7987613d978c9ea60202865e713355e03549210001568978c77da177e1242e77: Status 404 returned error can't find the container with id 7987613d978c9ea60202865e713355e03549210001568978c77da177e1242e77 Jul 09 18:07:19.688362 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:19.688332 2573 generic.go:356] "Generic (PLEG): container finished" podID="376a9448-2ea0-46ea-829c-c7852b75db42" containerID="27c969084e52d3f2a421cbf2d3186e41393b67a55714cc8e82e37b14d464cc9e" exitCode=0 Jul 09 18:07:19.688582 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:19.688424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerDied","Data":"27c969084e52d3f2a421cbf2d3186e41393b67a55714cc8e82e37b14d464cc9e"} Jul 09 18:07:19.688582 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:19.688527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"7987613d978c9ea60202865e713355e03549210001568978c77da177e1242e77"} Jul 09 18:07:20.005131 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.005101 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f75e364e-34db-44f4-8a32-5f6313b32e6f" path="/var/lib/kubelet/pods/f75e364e-34db-44f4-8a32-5f6313b32e6f/volumes" Jul 09 18:07:20.697038 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.696996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"a371e8873f293a17036073cb8b75a382d0d5f1824e2630dd3b2d9b4406aa84da"} Jul 09 18:07:20.697468 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.697089 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"2e3f77dc17852a1c417086c9b526f83e74dd94bcfb65dbdb581afd74f9112da1"} Jul 09 18:07:20.697468 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.697116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"b5b0e49839fad84938f538456979a95d72a51202d49bb3fb7759b048f45b43e0"} Jul 09 18:07:20.697468 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.697144 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"8ed1d1fae33418a3fcec029a5a90a9f1e1f75858bd2a8c5ddbd11162d6720e2a"} Jul 09 18:07:20.697468 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.697167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"f279eaedbc63953747a79eb8ebf202d9dcaf0dfd0d7de08b23a1a2d93c4883bd"} Jul 09 18:07:20.697468 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.697191 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"376a9448-2ea0-46ea-829c-c7852b75db42","Type":"ContainerStarted","Data":"25827294c2129731ba4fa9c247b6ac20b79243881a151da0ee5974c872f8b403"} Jul 09 18:07:20.742340 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:20.742274 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.726394096 podStartE2EDuration="2.742252692s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.858596ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:20.741383917 +0000 UTC m=+141.390538605" watchObservedRunningTime="2026-07-09 18:07:20.742252692 +0000 UTC m=+141.391407340" Jul 09 18:07:21.004945 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.004846 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5456c4f45b-dghdx"] Jul 09 18:07:21.007784 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.007761 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.010463 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.010425 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kmk2v\"" Jul 09 18:07:21.010593 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.010569 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 18:07:21.010656 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.010588 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 18:07:21.010721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.010677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 18:07:21.010785 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.010733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 18:07:21.010916 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.010891 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 18:07:21.017000 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.016978 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 18:07:21.024217 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.024185 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5456c4f45b-dghdx"] Jul 09 18:07:21.058744 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-secret-telemeter-client\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.058912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.058912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8lm\" (UniqueName: \"kubernetes.io/projected/6448a983-9e7f-4599-947d-6d55d93ba40a-kube-api-access-9j8lm\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.058912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-metrics-client-ca\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.058912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-federate-client-tls\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.058912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-serving-certs-ca-bundle\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.059211 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-telemeter-client-tls\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.059211 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.058973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159557 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-serving-certs-ca-bundle\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159557 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-telemeter-client-tls\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-secret-telemeter-client\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159648 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159666 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8lm\" (UniqueName: \"kubernetes.io/projected/6448a983-9e7f-4599-947d-6d55d93ba40a-kube-api-access-9j8lm\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.159775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.159685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-metrics-client-ca\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.160067 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.160044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-federate-client-tls\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.160431 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.160403 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-serving-certs-ca-bundle\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.160576 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.160549 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.160726 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.160695 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6448a983-9e7f-4599-947d-6d55d93ba40a-metrics-client-ca\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.162250 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.162227 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-telemeter-client-tls\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.162739 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.162717 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-secret-telemeter-client\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.162822 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.162745 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-federate-client-tls\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.162822 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.162754 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6448a983-9e7f-4599-947d-6d55d93ba40a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.168908 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.168886 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8lm\" (UniqueName: \"kubernetes.io/projected/6448a983-9e7f-4599-947d-6d55d93ba40a-kube-api-access-9j8lm\") pod \"telemeter-client-5456c4f45b-dghdx\" (UID: \"6448a983-9e7f-4599-947d-6d55d93ba40a\") " pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.288938 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.288850 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:07:21.289185 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.289131 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="prometheus" containerID="cri-o://b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" gracePeriod=600 Jul 09 18:07:21.289185 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.289169 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy" containerID="cri-o://28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" gracePeriod=600 Jul 09 18:07:21.289378 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.289169 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="thanos-sidecar" containerID="cri-o://3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" gracePeriod=600 Jul 09 18:07:21.289378 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.289208 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="config-reloader" containerID="cri-o://8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" gracePeriod=600 Jul 09 18:07:21.289378 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.289286 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-thanos" containerID="cri-o://df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" gracePeriod=600 Jul 09 18:07:21.289532 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.289374 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-web" containerID="cri-o://3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" gracePeriod=600 Jul 09 18:07:21.318301 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.318260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" Jul 09 18:07:21.480175 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.480148 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5456c4f45b-dghdx"] Jul 09 18:07:21.485932 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:07:21.485901 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6448a983_9e7f_4599_947d_6d55d93ba40a.slice/crio-1b79ec51af21593ff2c4d727413561c662e9e1cc90336d297f1826ad274f9011 WatchSource:0}: Error finding container 1b79ec51af21593ff2c4d727413561c662e9e1cc90336d297f1826ad274f9011: Status 404 returned error can't find the container with id 1b79ec51af21593ff2c4d727413561c662e9e1cc90336d297f1826ad274f9011 Jul 09 18:07:21.552365 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.552338 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.664989 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.664957 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-2\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.664989 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665000 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-tls-assets\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665035 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-serving-certs-ca-bundle\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665065 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-grpc-tls\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665086 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-1\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665112 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-config-out\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665133 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-tls\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665159 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665182 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-web-config\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665204 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-trusted-ca-bundle\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665248 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665242 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-kubelet-serving-ca-bundle\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665266 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v7cr\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-kube-api-access-6v7cr\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665294 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665325 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-thanos-prometheus-http-client-file\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665355 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665398 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-0\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665470 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-kube-rbac-proxy\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665500 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-metrics-client-certs\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665533 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665549 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-db\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665620 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-metrics-client-ca\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.665777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.665653 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-config\") pod \"2b6405c7-83b2-4578-b731-16e375abe457\" (UID: \"2b6405c7-83b2-4578-b731-16e375abe457\") " Jul 09 18:07:21.666271 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.666013 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.666271 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.666034 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.666781 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.666503 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.666897 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.666694 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:21.666965 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.666913 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.667725 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.667699 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.668190 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.668168 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:21.668328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.668302 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.668927 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.668899 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:21.668927 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.668914 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-config" (OuterVolumeSpecName: "config") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.669156 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.669129 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.669997 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.669961 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.669997 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.669972 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-config-out" (OuterVolumeSpecName: "config-out") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:21.670215 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.670188 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.670379 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.670351 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.670483 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.670437 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.670642 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.670622 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.670734 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.670714 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.671097 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.671070 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-kube-api-access-6v7cr" (OuterVolumeSpecName: "kube-api-access-6v7cr") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "kube-api-access-6v7cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:21.680236 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.680209 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-web-config" (OuterVolumeSpecName: "web-config") pod "2b6405c7-83b2-4578-b731-16e375abe457" (UID: "2b6405c7-83b2-4578-b731-16e375abe457"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:21.703089 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.703055 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" event={"ID":"6448a983-9e7f-4599-947d-6d55d93ba40a","Type":"ContainerStarted","Data":"1b79ec51af21593ff2c4d727413561c662e9e1cc90336d297f1826ad274f9011"} Jul 09 18:07:21.706116 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706091 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" exitCode=0 Jul 09 18:07:21.706116 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706113 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" exitCode=0 Jul 09 18:07:21.706116 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706119 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" exitCode=0 Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706126 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" exitCode=0 Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706132 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" exitCode=0 Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706137 2573 generic.go:356] "Generic (PLEG): container finished" podID="2b6405c7-83b2-4578-b731-16e375abe457" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" exitCode=0 Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706147 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706242 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706324 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.706359 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} Jul 09 18:07:21.706775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} Jul 09 18:07:21.706775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706431 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} Jul 09 18:07:21.706775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.706488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b6405c7-83b2-4578-b731-16e375abe457","Type":"ContainerDied","Data":"c01076b971b37375e6018bb304b71c087afd4494d84335c91b18c19ffc47ff6c"} Jul 09 18:07:21.716606 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.716573 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.724054 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.724034 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.730925 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.730908 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.739915 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.739021 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.742240 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.742210 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:07:21.744095 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.744072 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:07:21.749543 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.749514 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.757055 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.757037 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.764165 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764143 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.764426 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.764404 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.764517 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764440 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} err="failed to get container status \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" Jul 09 18:07:21.764517 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764482 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.764736 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.764718 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.764782 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764743 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} err="failed to get container status \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" Jul 09 18:07:21.764782 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764758 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.764971 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.764953 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.765008 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764978 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} err="failed to get container status \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" Jul 09 18:07:21.765008 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.764997 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.765186 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.765169 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.765260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765192 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} err="failed to get container status \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" Jul 09 18:07:21.765260 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765210 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.765400 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.765382 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.765438 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765405 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} err="failed to get container status \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" Jul 09 18:07:21.765438 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765418 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.765726 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.765709 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.765768 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765733 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} err="failed to get container status \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" Jul 09 18:07:21.765768 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765751 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.765951 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:07:21.765937 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.765991 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765953 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} err="failed to get container status \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" Jul 09 18:07:21.765991 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.765964 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.766193 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.766175 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} err="failed to get container status \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" Jul 09 18:07:21.766254 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.766194 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.766434 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.766407 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} err="failed to get container status \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" Jul 09 18:07:21.766852 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.766549 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.767391 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767145 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-kube-rbac-proxy\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767401 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-metrics-client-certs\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767420 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-db\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767435 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-metrics-client-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767472 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767486 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-tls-assets\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767500 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767513 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-grpc-tls\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767540 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b6405c7-83b2-4578-b731-16e375abe457-config-out\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767563 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.767581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767578 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767593 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-web-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767607 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767620 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767634 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v7cr\" (UniqueName: \"kubernetes.io/projected/2b6405c7-83b2-4578-b731-16e375abe457-kube-api-access-6v7cr\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767647 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767661 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b6405c7-83b2-4578-b731-16e375abe457-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767674 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b6405c7-83b2-4578-b731-16e375abe457-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767694 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} err="failed to get container status \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" Jul 09 18:07:21.768204 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.767749 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.768716 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.768696 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} err="failed to get container status \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" Jul 09 18:07:21.768771 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.768717 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.768988 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.768968 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} err="failed to get container status \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" Jul 09 18:07:21.769031 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.768989 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.769205 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769188 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} err="failed to get container status \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" Jul 09 18:07:21.769245 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769206 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.769433 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769414 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} err="failed to get container status \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" Jul 09 18:07:21.769534 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769434 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.769587 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769568 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:07:21.769706 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769680 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} err="failed to get container status \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" Jul 09 18:07:21.769792 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769761 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.769992 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769972 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="config-reloader" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.769995 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="config-reloader" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770005 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="init-config-reloader" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770011 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="init-config-reloader" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770025 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-thanos" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770032 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-thanos" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770043 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-web" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770049 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-web" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770056 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="prometheus" Jul 09 18:07:21.770060 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770048 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} err="failed to get container status \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770075 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770062 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="prometheus" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770131 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="thanos-sidecar" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770142 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="thanos-sidecar" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770164 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770170 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770253 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="config-reloader" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770264 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-web" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770272 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy-thanos" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770284 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="thanos-sidecar" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770297 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="prometheus" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770304 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6405c7-83b2-4578-b731-16e375abe457" containerName="kube-rbac-proxy" Jul 09 18:07:21.770488 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770480 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} err="failed to get container status \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" Jul 09 18:07:21.771082 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770507 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.771082 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770751 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} err="failed to get container status \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" Jul 09 18:07:21.771082 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.770773 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.771082 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771029 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} err="failed to get container status \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" Jul 09 18:07:21.771082 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771051 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.771340 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771318 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} err="failed to get container status \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" Jul 09 18:07:21.771382 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771342 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.771618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771595 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} err="failed to get container status \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" Jul 09 18:07:21.771618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771615 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.771832 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771813 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} err="failed to get container status \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" Jul 09 18:07:21.771888 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.771831 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.772078 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772058 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} err="failed to get container status \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" Jul 09 18:07:21.772128 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772078 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.772280 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772265 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} err="failed to get container status \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" Jul 09 18:07:21.772318 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772281 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.772502 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772486 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} err="failed to get container status \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" Jul 09 18:07:21.772552 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772502 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.772707 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772687 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} err="failed to get container status \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" Jul 09 18:07:21.772742 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772709 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.772924 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772904 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} err="failed to get container status \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" Jul 09 18:07:21.773001 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.772926 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.773133 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773117 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} err="failed to get container status \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" Jul 09 18:07:21.773195 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773135 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.773368 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773350 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} err="failed to get container status \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" Jul 09 18:07:21.773404 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773370 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.773567 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773551 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} err="failed to get container status \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" Jul 09 18:07:21.773616 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773568 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.773753 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773737 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} err="failed to get container status \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" Jul 09 18:07:21.773793 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773755 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.773953 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773929 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} err="failed to get container status \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" Jul 09 18:07:21.773953 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.773951 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.774190 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774167 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} err="failed to get container status \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" Jul 09 18:07:21.774190 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774189 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.774397 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774381 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} err="failed to get container status \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" Jul 09 18:07:21.774443 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774398 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.774598 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774581 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} err="failed to get container status \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" Jul 09 18:07:21.774667 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774599 2573 scope.go:117] "RemoveContainer" containerID="df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327" Jul 09 18:07:21.774744 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.774797 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774770 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327"} err="failed to get container status \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": rpc error: code = NotFound desc = could not find container \"df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327\": container with ID starting with df2b2119faaf988d8012e482f7be2e108756516e247a88ebc40c8a44d3708327 not found: ID does not exist" Jul 09 18:07:21.774797 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774784 2573 scope.go:117] "RemoveContainer" containerID="28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250" Jul 09 18:07:21.775136 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774954 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250"} err="failed to get container status \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": rpc error: code = NotFound desc = could not find container \"28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250\": container with ID starting with 28ae147159519e7dfe456c4943586cf029f2c9669cc6285989961b08bf305250 not found: ID does not exist" Jul 09 18:07:21.775136 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.774983 2573 scope.go:117] "RemoveContainer" containerID="3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0" Jul 09 18:07:21.775361 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.775339 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0"} err="failed to get container status \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": rpc error: code = NotFound desc = could not find container \"3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0\": container with ID starting with 3eca1f3e4c20a8dc51718588e507f9e7a1293213aeae8ed729047cea7138eac0 not found: ID does not exist" Jul 09 18:07:21.775361 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.775361 2573 scope.go:117] "RemoveContainer" containerID="3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610" Jul 09 18:07:21.775618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.775600 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610"} err="failed to get container status \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": rpc error: code = NotFound desc = could not find container \"3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610\": container with ID starting with 3dfb63ae06af03f1e91fa34fd6e43df48b4bd0ee6f0a5b5392e0a135e9152610 not found: ID does not exist" Jul 09 18:07:21.775661 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.775620 2573 scope.go:117] "RemoveContainer" containerID="8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b" Jul 09 18:07:21.775855 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.775838 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b"} err="failed to get container status \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": rpc error: code = NotFound desc = could not find container \"8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b\": container with ID starting with 8fbf11b0bfba38427e55c49ad8c419f1977a9853ae0f3bbee65f42a08148dc2b not found: ID does not exist" Jul 09 18:07:21.775912 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.775855 2573 scope.go:117] "RemoveContainer" containerID="b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb" Jul 09 18:07:21.776080 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.776052 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb"} err="failed to get container status \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": rpc error: code = NotFound desc = could not find container \"b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb\": container with ID starting with b2eec33a38dbd7ec9ad66d40f23281909c42d42b74d749ebc25dbef87f73bbdb not found: ID does not exist" Jul 09 18:07:21.776080 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.776072 2573 scope.go:117] "RemoveContainer" containerID="2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640" Jul 09 18:07:21.776300 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.776279 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640"} err="failed to get container status \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": rpc error: code = NotFound desc = could not find container \"2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640\": container with ID starting with 2b62a50c82b8c2b6e33444d9e6483829e0f4893bd43b780ffd47b4a8bc2c3640 not found: ID does not exist" Jul 09 18:07:21.777499 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777483 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 18:07:21.777571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 18:07:21.777571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777516 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e6oe3a2meskn5\"" Jul 09 18:07:21.777571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777543 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 18:07:21.777727 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777617 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 18:07:21.777905 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777888 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 18:07:21.777973 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777890 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 18:07:21.777973 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777959 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 18:07:21.777973 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777970 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b99zg\"" Jul 09 18:07:21.778100 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.777988 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 18:07:21.778174 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.778159 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 18:07:21.778258 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.778244 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 18:07:21.778439 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.778423 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 18:07:21.778509 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.778497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 18:07:21.781624 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.781606 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 18:07:21.784398 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.784378 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 18:07:21.792328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.792272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:07:21.868775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868741 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868775 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868777 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-config\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868930 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.868969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.868981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869002 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8rq\" (UniqueName: \"kubernetes.io/projected/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-kube-api-access-bl8rq\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869315 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869315 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869315 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869315 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869315 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.869315 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.869302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.969962 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.969928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.969962 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.969965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.969980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8rq\" (UniqueName: \"kubernetes.io/projected/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-kube-api-access-bl8rq\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970216 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970508 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970565 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970565 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970675 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970675 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970675 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.970812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970809 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.971058 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.971058 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-config\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.971058 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.970871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.971545 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.971514 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973164 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973135 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973361 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973338 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973361 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973354 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973521 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973491 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973521 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973498 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973697 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973674 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.973760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.973736 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.974227 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.974200 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.974323 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.974257 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.974323 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.974278 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.974614 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.974593 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.974910 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.974885 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.975746 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.975728 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.976145 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.976119 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.976217 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.976163 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-config\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.976384 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.976369 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:21.978476 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:21.978439 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8rq\" (UniqueName: \"kubernetes.io/projected/2dd16f6b-07b3-4bd5-80ee-f4c1612302a5-kube-api-access-bl8rq\") pod \"prometheus-k8s-0\" (UID: \"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:22.005205 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:22.005177 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6405c7-83b2-4578-b731-16e375abe457" path="/var/lib/kubelet/pods/2b6405c7-83b2-4578-b731-16e375abe457/volumes" Jul 09 18:07:22.084786 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:22.084701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:22.223244 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:22.223212 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 18:07:22.226857 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:07:22.226829 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd16f6b_07b3_4bd5_80ee_f4c1612302a5.slice/crio-37ecb07c302feeff51c2bece8b7c3bfe75b6c826fcdde96aea3f9cd6d36c6c38 WatchSource:0}: Error finding container 37ecb07c302feeff51c2bece8b7c3bfe75b6c826fcdde96aea3f9cd6d36c6c38: Status 404 returned error can't find the container with id 37ecb07c302feeff51c2bece8b7c3bfe75b6c826fcdde96aea3f9cd6d36c6c38 Jul 09 18:07:22.713988 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:22.713951 2573 generic.go:356] "Generic (PLEG): container finished" podID="2dd16f6b-07b3-4bd5-80ee-f4c1612302a5" containerID="1cc97ab060d1ae78e431fcdd8d8b34b7438864e69b0a08618366e95d10ae88ed" exitCode=0 Jul 09 18:07:22.714492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:22.714047 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerDied","Data":"1cc97ab060d1ae78e431fcdd8d8b34b7438864e69b0a08618366e95d10ae88ed"} Jul 09 18:07:22.714492 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:22.714131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"37ecb07c302feeff51c2bece8b7c3bfe75b6c826fcdde96aea3f9cd6d36c6c38"} Jul 09 18:07:23.723289 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.723258 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"19db55e1652e3dab96ea2ff794ca72b5bbd6b0f3778a0f61554cd6b603b037b5"} Jul 09 18:07:23.723790 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.723365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"961dc4c48c074b4fd2d8b70ffb9f23bae14f5f30cba65e8159c95cdcae9029bb"} Jul 09 18:07:23.723790 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.723406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"f4335b6fa29d9ad9f8203e0f2c43b81d7e57f3fada1016ae744a7aac8878f0ed"} Jul 09 18:07:23.723790 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.723442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"caa949540d231fc482be8c094c1f679baf5cdeadaf4b332f5a530a749566cc37"} Jul 09 18:07:23.723790 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.723498 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"a77dd2a57a057fff60d6af14f44136a35557e48eeb471a5bca124ffdc65a1a16"} Jul 09 18:07:23.723790 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.723527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd16f6b-07b3-4bd5-80ee-f4c1612302a5","Type":"ContainerStarted","Data":"643ade464a3e0867a979b8c151530cd24700ea0cd12145514c585de4c86917bb"} Jul 09 18:07:23.725465 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.725432 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" event={"ID":"6448a983-9e7f-4599-947d-6d55d93ba40a","Type":"ContainerStarted","Data":"4da0fe62cf28fb06dd59cfe117a3ac16a4627b8617e9e023743028ade424ec7a"} Jul 09 18:07:23.725545 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.725493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" event={"ID":"6448a983-9e7f-4599-947d-6d55d93ba40a","Type":"ContainerStarted","Data":"f928c64e6eb3928f27c72a4f47a935c12f0df43457da283d1993389e8f687646"} Jul 09 18:07:23.725545 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.725514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" event={"ID":"6448a983-9e7f-4599-947d-6d55d93ba40a","Type":"ContainerStarted","Data":"87ad945e746ca15b80dffa4cd27cf28ca9d1c01222a9e73d5db3f0ac004a7f5c"} Jul 09 18:07:23.749845 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.749786 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.72631604 podStartE2EDuration="2.749767867s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.451827ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:23.747900193 +0000 UTC m=+144.397054862" watchObservedRunningTime="2026-07-09 18:07:23.749767867 +0000 UTC m=+144.398922514" Jul 09 18:07:23.768159 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:23.768093 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5456c4f45b-dghdx" podStartSLOduration=1.712050574 podStartE2EDuration="3.768073223s" totalImagesPullingTime="2.056022649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:23.767892401 +0000 UTC m=+144.417047068" watchObservedRunningTime="2026-07-09 18:07:23.768073223 +0000 UTC m=+144.417227870" Jul 09 18:07:24.567923 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.567874 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5596dc45d7-842g8"] Jul 09 18:07:24.570901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.570880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.584932 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.584905 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5596dc45d7-842g8"] Jul 09 18:07:24.596705 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-service-ca\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.596838 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t4f4\" (UniqueName: \"kubernetes.io/projected/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-kube-api-access-8t4f4\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.596838 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-config\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.596838 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-oauth-serving-cert\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.596838 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-serving-cert\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.596961 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-oauth-config\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.596961 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.596897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-trusted-ca-bundle\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697687 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-service-ca\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4f4\" (UniqueName: \"kubernetes.io/projected/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-kube-api-access-8t4f4\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-config\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-oauth-serving-cert\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-serving-cert\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697791 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-oauth-config\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.697883 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.697830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-trusted-ca-bundle\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.698602 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.698574 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-service-ca\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.698723 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.698574 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-oauth-serving-cert\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.698723 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.698586 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-config\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.698809 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.698731 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-trusted-ca-bundle\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.700336 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.700314 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-serving-cert\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.700435 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.700417 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-oauth-config\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.709004 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.708981 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t4f4\" (UniqueName: \"kubernetes.io/projected/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-kube-api-access-8t4f4\") pod \"console-5596dc45d7-842g8\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:24.880262 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:24.880156 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:25.011907 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:25.011869 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5596dc45d7-842g8"] Jul 09 18:07:25.014823 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:07:25.014795 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5a7e9e_033d_4cc9_aa84_f1d563ecf297.slice/crio-8a24da24a14c6228ea09a013626a0887483d53d2b36621ff8d99cf16367d2850 WatchSource:0}: Error finding container 8a24da24a14c6228ea09a013626a0887483d53d2b36621ff8d99cf16367d2850: Status 404 returned error can't find the container with id 8a24da24a14c6228ea09a013626a0887483d53d2b36621ff8d99cf16367d2850 Jul 09 18:07:25.735666 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:25.735631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596dc45d7-842g8" event={"ID":"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297","Type":"ContainerStarted","Data":"eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f"} Jul 09 18:07:25.735838 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:25.735686 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596dc45d7-842g8" event={"ID":"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297","Type":"ContainerStarted","Data":"8a24da24a14c6228ea09a013626a0887483d53d2b36621ff8d99cf16367d2850"} Jul 09 18:07:25.756200 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:25.756142 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5596dc45d7-842g8" podStartSLOduration=1.756123535 podStartE2EDuration="1.756123535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:25.754703304 +0000 UTC m=+146.403857977" watchObservedRunningTime="2026-07-09 18:07:25.756123535 +0000 UTC m=+146.405278182" Jul 09 18:07:27.085302 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:27.085248 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:07:34.881175 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:34.881148 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:34.881701 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:34.881231 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:34.885489 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:34.885469 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:35.786739 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:35.786709 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:07:35.834358 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:07:35.834330 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d6b7d5d7c-8bwtw"] Jul 09 18:08:00.855190 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:00.855123 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d6b7d5d7c-8bwtw" podUID="a9805ec1-141d-4cbd-9012-ee7d2d271423" containerName="console" containerID="cri-o://e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0" gracePeriod=15 Jul 09 18:08:01.098820 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.098796 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:08:01.121667 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121600 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-config\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.121807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121694 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-service-ca\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.121807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121712 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-oauth-serving-cert\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.121807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121736 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-serving-cert\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.121807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121760 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbbdf\" (UniqueName: \"kubernetes.io/projected/a9805ec1-141d-4cbd-9012-ee7d2d271423-kube-api-access-kbbdf\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.121807 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121807 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-trusted-ca-bundle\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.122075 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.121853 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-oauth-config\") pod \"a9805ec1-141d-4cbd-9012-ee7d2d271423\" (UID: \"a9805ec1-141d-4cbd-9012-ee7d2d271423\") " Jul 09 18:08:01.122137 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.122070 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-config" (OuterVolumeSpecName: "console-config") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:01.122193 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.122163 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:01.122193 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.122177 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:01.122635 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.122593 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:01.124222 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.124194 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:08:01.124321 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.124240 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9805ec1-141d-4cbd-9012-ee7d2d271423-kube-api-access-kbbdf" (OuterVolumeSpecName: "kube-api-access-kbbdf") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "kube-api-access-kbbdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:08:01.124397 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.124377 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9805ec1-141d-4cbd-9012-ee7d2d271423" (UID: "a9805ec1-141d-4cbd-9012-ee7d2d271423"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:08:01.223033 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.222986 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.223033 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.223026 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.223033 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.223038 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.223274 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.223050 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.223274 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.223062 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbbdf\" (UniqueName: \"kubernetes.io/projected/a9805ec1-141d-4cbd-9012-ee7d2d271423-kube-api-access-kbbdf\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.223274 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.223073 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9805ec1-141d-4cbd-9012-ee7d2d271423-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.223274 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.223084 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9805ec1-141d-4cbd-9012-ee7d2d271423-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:08:01.887923 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.887891 2573 generic.go:356] "Generic (PLEG): container finished" podID="a9805ec1-141d-4cbd-9012-ee7d2d271423" containerID="e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0" exitCode=0 Jul 09 18:08:01.888348 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.887933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6b7d5d7c-8bwtw" event={"ID":"a9805ec1-141d-4cbd-9012-ee7d2d271423","Type":"ContainerDied","Data":"e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0"} Jul 09 18:08:01.888348 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.887935 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6b7d5d7c-8bwtw" Jul 09 18:08:01.888348 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.887978 2573 scope.go:117] "RemoveContainer" containerID="e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0" Jul 09 18:08:01.888348 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.887968 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6b7d5d7c-8bwtw" event={"ID":"a9805ec1-141d-4cbd-9012-ee7d2d271423","Type":"ContainerDied","Data":"c3c52c13f1d2fcce86a8b709c02d489dccdf0b9882211c1dffba87739dd6e4a6"} Jul 09 18:08:01.896570 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.896554 2573 scope.go:117] "RemoveContainer" containerID="e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0" Jul 09 18:08:01.896845 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:08:01.896827 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0\": container with ID starting with e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0 not found: ID does not exist" containerID="e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0" Jul 09 18:08:01.896903 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.896853 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0"} err="failed to get container status \"e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0\": rpc error: code = NotFound desc = could not find container \"e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0\": container with ID starting with e9b394ed8451966e36d365526310dc551dce0f60c131acb6be4b56c27e8407e0 not found: ID does not exist" Jul 09 18:08:01.907875 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.907853 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d6b7d5d7c-8bwtw"] Jul 09 18:08:01.911167 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:01.911147 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d6b7d5d7c-8bwtw"] Jul 09 18:08:02.003822 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:02.003787 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9805ec1-141d-4cbd-9012-ee7d2d271423" path="/var/lib/kubelet/pods/a9805ec1-141d-4cbd-9012-ee7d2d271423/volumes" Jul 09 18:08:22.085308 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:22.085259 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:08:22.100718 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:22.100697 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:08:22.992375 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:22.992343 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 18:08:37.609178 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.609137 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb7bcfdd6-bt6b9"] Jul 09 18:08:37.609664 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.609506 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9805ec1-141d-4cbd-9012-ee7d2d271423" containerName="console" Jul 09 18:08:37.609664 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.609519 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9805ec1-141d-4cbd-9012-ee7d2d271423" containerName="console" Jul 09 18:08:37.609664 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.609580 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9805ec1-141d-4cbd-9012-ee7d2d271423" containerName="console" Jul 09 18:08:37.613674 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.613652 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.626518 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.626494 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb7bcfdd6-bt6b9"] Jul 09 18:08:37.745338 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-service-ca\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.745338 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745338 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d994k\" (UniqueName: \"kubernetes.io/projected/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-kube-api-access-d994k\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.745598 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-serving-cert\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.745598 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-oauth-config\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.745598 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-config\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.745598 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-oauth-serving-cert\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.745598 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.745526 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-trusted-ca-bundle\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846713 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-oauth-serving-cert\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-trusted-ca-bundle\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-service-ca\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d994k\" (UniqueName: \"kubernetes.io/projected/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-kube-api-access-d994k\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-serving-cert\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-oauth-config\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.846886 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.846885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-config\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.847544 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.847518 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-oauth-serving-cert\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.847655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.847572 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-service-ca\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.847698 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.847651 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-config\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.847698 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.847665 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-trusted-ca-bundle\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.849251 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.849222 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-oauth-config\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.849402 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.849383 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-serving-cert\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.855825 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.855802 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d994k\" (UniqueName: \"kubernetes.io/projected/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-kube-api-access-d994k\") pod \"console-6bb7bcfdd6-bt6b9\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:37.922001 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:37.921974 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:38.054901 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:38.054878 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb7bcfdd6-bt6b9"] Jul 09 18:08:38.057128 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:08:38.057095 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433c8b4a_a004_4bda_9bdb_bccc5bce1f25.slice/crio-a0447b68d910db83aa735b89ba4db676dec2eaa7da9c9b48fad75cbbf8ee6f7b WatchSource:0}: Error finding container a0447b68d910db83aa735b89ba4db676dec2eaa7da9c9b48fad75cbbf8ee6f7b: Status 404 returned error can't find the container with id a0447b68d910db83aa735b89ba4db676dec2eaa7da9c9b48fad75cbbf8ee6f7b Jul 09 18:08:39.037363 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:39.037330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb7bcfdd6-bt6b9" event={"ID":"433c8b4a-a004-4bda-9bdb-bccc5bce1f25","Type":"ContainerStarted","Data":"08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd"} Jul 09 18:08:39.037746 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:39.037381 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb7bcfdd6-bt6b9" event={"ID":"433c8b4a-a004-4bda-9bdb-bccc5bce1f25","Type":"ContainerStarted","Data":"a0447b68d910db83aa735b89ba4db676dec2eaa7da9c9b48fad75cbbf8ee6f7b"} Jul 09 18:08:39.058188 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:39.058140 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bb7bcfdd6-bt6b9" podStartSLOduration=2.058123364 podStartE2EDuration="2.058123364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:08:39.057438915 +0000 UTC m=+219.706593573" watchObservedRunningTime="2026-07-09 18:08:39.058123364 +0000 UTC m=+219.707278011" Jul 09 18:08:47.923112 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:47.923059 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:47.923112 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:47.923130 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:47.927997 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:47.927973 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:48.087885 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:48.087856 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:08:48.133418 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:08:48.133386 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5596dc45d7-842g8"] Jul 09 18:09:13.158850 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.158776 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5596dc45d7-842g8" podUID="1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" containerName="console" containerID="cri-o://eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f" gracePeriod=15 Jul 09 18:09:13.404167 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.404145 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:09:13.555278 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555242 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-service-ca\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555489 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555303 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-serving-cert\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555489 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555333 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-trusted-ca-bundle\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555489 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555353 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-oauth-serving-cert\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555489 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555381 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-oauth-config\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555716 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555492 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-config\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555716 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555547 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t4f4\" (UniqueName: \"kubernetes.io/projected/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-kube-api-access-8t4f4\") pod \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\" (UID: \"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297\") " Jul 09 18:09:13.555870 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555840 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:09:13.555948 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555881 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:09:13.556000 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555974 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-config" (OuterVolumeSpecName: "console-config") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:09:13.556000 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.555986 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:09:13.557652 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.557627 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:09:13.557750 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.557709 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:09:13.557789 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.557750 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-kube-api-access-8t4f4" (OuterVolumeSpecName: "kube-api-access-8t4f4") pod "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" (UID: "1f5a7e9e-033d-4cc9-aa84-f1d563ecf297"). InnerVolumeSpecName "kube-api-access-8t4f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:09:13.656345 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656315 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:13.656345 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656341 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:13.656345 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656351 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:13.656580 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656360 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:13.656580 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656369 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t4f4\" (UniqueName: \"kubernetes.io/projected/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-kube-api-access-8t4f4\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:13.656580 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656378 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:13.656580 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:13.656387 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:09:14.187289 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.187258 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" containerID="eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f" exitCode=0 Jul 09 18:09:14.187721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.187302 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596dc45d7-842g8" Jul 09 18:09:14.187721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.187310 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596dc45d7-842g8" event={"ID":"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297","Type":"ContainerDied","Data":"eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f"} Jul 09 18:09:14.187721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.187349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596dc45d7-842g8" event={"ID":"1f5a7e9e-033d-4cc9-aa84-f1d563ecf297","Type":"ContainerDied","Data":"8a24da24a14c6228ea09a013626a0887483d53d2b36621ff8d99cf16367d2850"} Jul 09 18:09:14.187721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.187378 2573 scope.go:117] "RemoveContainer" containerID="eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f" Jul 09 18:09:14.195873 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.195858 2573 scope.go:117] "RemoveContainer" containerID="eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f" Jul 09 18:09:14.196129 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:09:14.196107 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f\": container with ID starting with eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f not found: ID does not exist" containerID="eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f" Jul 09 18:09:14.196172 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.196136 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f"} err="failed to get container status \"eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f\": rpc error: code = NotFound desc = could not find container \"eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f\": container with ID starting with eb0992bb6fbf748375d9c1741ae089e940c13c909ce8437f1e97eb6d948c4c8f not found: ID does not exist" Jul 09 18:09:14.204088 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.204062 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5596dc45d7-842g8"] Jul 09 18:09:14.208388 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:14.208369 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5596dc45d7-842g8"] Jul 09 18:09:16.009754 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:16.009719 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" path="/var/lib/kubelet/pods/1f5a7e9e-033d-4cc9-aa84-f1d563ecf297/volumes" Jul 09 18:09:59.751628 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:59.751597 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:09:59.752153 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:59.751655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:09:59.761689 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:09:59.761663 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 18:11:28.073155 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.073121 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-t5r58"] Jul 09 18:11:28.073646 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.073473 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" containerName="console" Jul 09 18:11:28.073646 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.073485 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" containerName="console" Jul 09 18:11:28.073646 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.073538 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f5a7e9e-033d-4cc9-aa84-f1d563ecf297" containerName="console" Jul 09 18:11:28.076399 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.076381 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.078978 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.078959 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 09 18:11:28.079093 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.079014 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 09 18:11:28.079093 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.079020 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-5kffs\"" Jul 09 18:11:28.079844 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.079830 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 09 18:11:28.084810 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.084788 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-t5r58"] Jul 09 18:11:28.228996 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.228951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/219396a3-ee06-424d-88ef-ef4cc7f7aa81-data\") pod \"seaweedfs-64568bcd49-t5r58\" (UID: \"219396a3-ee06-424d-88ef-ef4cc7f7aa81\") " pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.228996 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.228999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtlp\" (UniqueName: \"kubernetes.io/projected/219396a3-ee06-424d-88ef-ef4cc7f7aa81-kube-api-access-bqtlp\") pod \"seaweedfs-64568bcd49-t5r58\" (UID: \"219396a3-ee06-424d-88ef-ef4cc7f7aa81\") " pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.329962 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.329879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/219396a3-ee06-424d-88ef-ef4cc7f7aa81-data\") pod \"seaweedfs-64568bcd49-t5r58\" (UID: \"219396a3-ee06-424d-88ef-ef4cc7f7aa81\") " pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.329962 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.329914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtlp\" (UniqueName: \"kubernetes.io/projected/219396a3-ee06-424d-88ef-ef4cc7f7aa81-kube-api-access-bqtlp\") pod \"seaweedfs-64568bcd49-t5r58\" (UID: \"219396a3-ee06-424d-88ef-ef4cc7f7aa81\") " pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.330336 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.330313 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/219396a3-ee06-424d-88ef-ef4cc7f7aa81-data\") pod \"seaweedfs-64568bcd49-t5r58\" (UID: \"219396a3-ee06-424d-88ef-ef4cc7f7aa81\") " pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.338012 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.337990 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtlp\" (UniqueName: \"kubernetes.io/projected/219396a3-ee06-424d-88ef-ef4cc7f7aa81-kube-api-access-bqtlp\") pod \"seaweedfs-64568bcd49-t5r58\" (UID: \"219396a3-ee06-424d-88ef-ef4cc7f7aa81\") " pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.386030 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.386000 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:28.515164 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.515135 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-t5r58"] Jul 09 18:11:28.517795 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:11:28.517769 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219396a3_ee06_424d_88ef_ef4cc7f7aa81.slice/crio-c8a7410902f0c29e18e2247db1c0c285d86c1366198a517179fde0fc3def246d WatchSource:0}: Error finding container c8a7410902f0c29e18e2247db1c0c285d86c1366198a517179fde0fc3def246d: Status 404 returned error can't find the container with id c8a7410902f0c29e18e2247db1c0c285d86c1366198a517179fde0fc3def246d Jul 09 18:11:28.519015 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.519000 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 18:11:28.720462 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:28.720426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-t5r58" event={"ID":"219396a3-ee06-424d-88ef-ef4cc7f7aa81","Type":"ContainerStarted","Data":"c8a7410902f0c29e18e2247db1c0c285d86c1366198a517179fde0fc3def246d"} Jul 09 18:11:32.740178 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:32.740141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-t5r58" event={"ID":"219396a3-ee06-424d-88ef-ef4cc7f7aa81","Type":"ContainerStarted","Data":"0de9416f6b5203e36f5c39b913c2e060892a6bd2835fc35a7eb8958a620fc3a0"} Jul 09 18:11:32.740592 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:32.740278 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:11:32.758055 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:32.758004 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-t5r58" podStartSLOduration=1.169282048 podStartE2EDuration="4.757990715s" totalImagesPullingTime="3.588708667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:32.755706315 +0000 UTC m=+393.404860983" watchObservedRunningTime="2026-07-09 18:11:32.757990715 +0000 UTC m=+393.407145362" Jul 09 18:11:38.747463 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:11:38.747419 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-t5r58" Jul 09 18:12:05.152268 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.152228 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-tkjxq"] Jul 09 18:12:05.157659 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.157636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.161289 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.161268 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 09 18:12:05.161393 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.161271 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-jftsf\"" Jul 09 18:12:05.166687 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.166664 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-tkjxq"] Jul 09 18:12:05.255087 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.255051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxn9w\" (UniqueName: \"kubernetes.io/projected/a68fd682-932c-41ee-9137-8300cc729d92-kube-api-access-cxn9w\") pod \"kserve-controller-manager-57b57d8c6-tkjxq\" (UID: \"a68fd682-932c-41ee-9137-8300cc729d92\") " pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.255087 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.255090 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68fd682-932c-41ee-9137-8300cc729d92-cert\") pod \"kserve-controller-manager-57b57d8c6-tkjxq\" (UID: \"a68fd682-932c-41ee-9137-8300cc729d92\") " pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.356149 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.356114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxn9w\" (UniqueName: \"kubernetes.io/projected/a68fd682-932c-41ee-9137-8300cc729d92-kube-api-access-cxn9w\") pod \"kserve-controller-manager-57b57d8c6-tkjxq\" (UID: \"a68fd682-932c-41ee-9137-8300cc729d92\") " pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.356304 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.356156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68fd682-932c-41ee-9137-8300cc729d92-cert\") pod \"kserve-controller-manager-57b57d8c6-tkjxq\" (UID: \"a68fd682-932c-41ee-9137-8300cc729d92\") " pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.358581 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.358558 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68fd682-932c-41ee-9137-8300cc729d92-cert\") pod \"kserve-controller-manager-57b57d8c6-tkjxq\" (UID: \"a68fd682-932c-41ee-9137-8300cc729d92\") " pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.364657 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.364633 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxn9w\" (UniqueName: \"kubernetes.io/projected/a68fd682-932c-41ee-9137-8300cc729d92-kube-api-access-cxn9w\") pod \"kserve-controller-manager-57b57d8c6-tkjxq\" (UID: \"a68fd682-932c-41ee-9137-8300cc729d92\") " pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.468780 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.468744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:05.594065 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.594042 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-tkjxq"] Jul 09 18:12:05.596562 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:12:05.596539 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68fd682_932c_41ee_9137_8300cc729d92.slice/crio-2547583b31456457add0d4556b57e97fdcbba8f798c0b7df6a73ccb429792ef2 WatchSource:0}: Error finding container 2547583b31456457add0d4556b57e97fdcbba8f798c0b7df6a73ccb429792ef2: Status 404 returned error can't find the container with id 2547583b31456457add0d4556b57e97fdcbba8f798c0b7df6a73ccb429792ef2 Jul 09 18:12:05.869247 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:05.869166 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" event={"ID":"a68fd682-932c-41ee-9137-8300cc729d92","Type":"ContainerStarted","Data":"2547583b31456457add0d4556b57e97fdcbba8f798c0b7df6a73ccb429792ef2"} Jul 09 18:12:09.888285 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:09.888245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" event={"ID":"a68fd682-932c-41ee-9137-8300cc729d92","Type":"ContainerStarted","Data":"5d20a76f51ac8313a887a9bf47d54b99fc44b064ee8201c4dd21a4e4aa468ae8"} Jul 09 18:12:09.888693 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:09.888361 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:09.905368 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:09.905322 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" podStartSLOduration=1.4508874330000001 podStartE2EDuration="4.905304594s" totalImagesPullingTime="3.454417161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:09.904819181 +0000 UTC m=+430.553973864" watchObservedRunningTime="2026-07-09 18:12:09.905304594 +0000 UTC m=+430.554459240" Jul 09 18:12:28.768067 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.767974 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54887fbfcd-dd5t9"] Jul 09 18:12:28.770475 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.770436 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.782567 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.782545 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54887fbfcd-dd5t9"] Jul 09 18:12:28.866433 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfcv\" (UniqueName: \"kubernetes.io/projected/96c7e396-7aed-4de1-9bea-b51612e2ed1a-kube-api-access-djfcv\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.866611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-trusted-ca-bundle\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.866611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-config\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.866611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-oauth-serving-cert\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.866611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-serving-cert\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.866611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-oauth-config\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.866611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.866573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-service-ca\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967329 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfcv\" (UniqueName: \"kubernetes.io/projected/96c7e396-7aed-4de1-9bea-b51612e2ed1a-kube-api-access-djfcv\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967508 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-trusted-ca-bundle\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967508 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-config\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-oauth-serving-cert\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-serving-cert\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-oauth-config\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.967618 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.967565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-service-ca\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.968285 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.968263 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-oauth-serving-cert\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.968400 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.968297 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-config\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.968400 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.968363 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-trusted-ca-bundle\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.968400 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.968364 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96c7e396-7aed-4de1-9bea-b51612e2ed1a-service-ca\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.970043 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.970024 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-oauth-config\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.970095 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.970028 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96c7e396-7aed-4de1-9bea-b51612e2ed1a-console-serving-cert\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:28.976585 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:28.976563 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfcv\" (UniqueName: \"kubernetes.io/projected/96c7e396-7aed-4de1-9bea-b51612e2ed1a-kube-api-access-djfcv\") pod \"console-54887fbfcd-dd5t9\" (UID: \"96c7e396-7aed-4de1-9bea-b51612e2ed1a\") " pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:29.079048 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:29.078963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:29.226964 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:29.226937 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54887fbfcd-dd5t9"] Jul 09 18:12:29.229388 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:12:29.229356 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c7e396_7aed_4de1_9bea_b51612e2ed1a.slice/crio-61797911770f045ad8e9aadf2c9c543f7400bfffc8f00ca333ddee0494dbf3db WatchSource:0}: Error finding container 61797911770f045ad8e9aadf2c9c543f7400bfffc8f00ca333ddee0494dbf3db: Status 404 returned error can't find the container with id 61797911770f045ad8e9aadf2c9c543f7400bfffc8f00ca333ddee0494dbf3db Jul 09 18:12:29.969089 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:29.969054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54887fbfcd-dd5t9" event={"ID":"96c7e396-7aed-4de1-9bea-b51612e2ed1a","Type":"ContainerStarted","Data":"f441b7ca71d8d28b430d1c774c3355ce5ba764d14e5779bfb65b8bcc5f20f493"} Jul 09 18:12:29.969537 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:29.969127 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54887fbfcd-dd5t9" event={"ID":"96c7e396-7aed-4de1-9bea-b51612e2ed1a","Type":"ContainerStarted","Data":"61797911770f045ad8e9aadf2c9c543f7400bfffc8f00ca333ddee0494dbf3db"} Jul 09 18:12:29.988408 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:29.988359 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54887fbfcd-dd5t9" podStartSLOduration=1.988345708 podStartE2EDuration="1.988345708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:29.986928875 +0000 UTC m=+450.636083557" watchObservedRunningTime="2026-07-09 18:12:29.988345708 +0000 UTC m=+450.637500354" Jul 09 18:12:39.079811 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:39.079778 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:39.080282 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:39.079827 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:39.084611 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:39.084590 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:40.015644 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:40.015616 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54887fbfcd-dd5t9" Jul 09 18:12:40.060289 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:40.060258 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb7bcfdd6-bt6b9"] Jul 09 18:12:40.897059 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:40.897031 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-57b57d8c6-tkjxq" Jul 09 18:12:58.783697 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.783662 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-h6p5l"] Jul 09 18:12:58.786340 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.786321 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-h6p5l" Jul 09 18:12:58.805494 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.805463 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-h6p5l"] Jul 09 18:12:58.839485 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.839434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrzv\" (UniqueName: \"kubernetes.io/projected/94d1cb45-dd84-4d2a-9fdd-197e829b8409-kube-api-access-nbrzv\") pod \"s3-init-h6p5l\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " pod="kserve/s3-init-h6p5l" Jul 09 18:12:58.839630 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.839580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94d1cb45-dd84-4d2a-9fdd-197e829b8409-model-cache\") pod \"s3-init-h6p5l\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " pod="kserve/s3-init-h6p5l" Jul 09 18:12:58.940180 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.940140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94d1cb45-dd84-4d2a-9fdd-197e829b8409-model-cache\") pod \"s3-init-h6p5l\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " pod="kserve/s3-init-h6p5l" Jul 09 18:12:58.940342 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.940195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrzv\" (UniqueName: \"kubernetes.io/projected/94d1cb45-dd84-4d2a-9fdd-197e829b8409-kube-api-access-nbrzv\") pod \"s3-init-h6p5l\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " pod="kserve/s3-init-h6p5l" Jul 09 18:12:58.940635 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.940615 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94d1cb45-dd84-4d2a-9fdd-197e829b8409-model-cache\") pod \"s3-init-h6p5l\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " pod="kserve/s3-init-h6p5l" Jul 09 18:12:58.948837 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:58.948815 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrzv\" (UniqueName: \"kubernetes.io/projected/94d1cb45-dd84-4d2a-9fdd-197e829b8409-kube-api-access-nbrzv\") pod \"s3-init-h6p5l\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " pod="kserve/s3-init-h6p5l" Jul 09 18:12:59.108202 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:59.108117 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-h6p5l" Jul 09 18:12:59.234814 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:12:59.234791 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-h6p5l"] Jul 09 18:12:59.237358 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:12:59.237327 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94d1cb45_dd84_4d2a_9fdd_197e829b8409.slice/crio-392c285665da83df5ab7d3b4c0bbed16b32203c8f8d773c2a59cabe4fa6bf0ce WatchSource:0}: Error finding container 392c285665da83df5ab7d3b4c0bbed16b32203c8f8d773c2a59cabe4fa6bf0ce: Status 404 returned error can't find the container with id 392c285665da83df5ab7d3b4c0bbed16b32203c8f8d773c2a59cabe4fa6bf0ce Jul 09 18:13:00.095058 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:00.095025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-h6p5l" event={"ID":"94d1cb45-dd84-4d2a-9fdd-197e829b8409","Type":"ContainerStarted","Data":"392c285665da83df5ab7d3b4c0bbed16b32203c8f8d773c2a59cabe4fa6bf0ce"} Jul 09 18:13:04.116875 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:04.116833 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-h6p5l" event={"ID":"94d1cb45-dd84-4d2a-9fdd-197e829b8409","Type":"ContainerStarted","Data":"fba9dc1b949a6ab8109734eb340b6fdfdcd715e9a0e08248d56a52c60753a264"} Jul 09 18:13:05.088051 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.088010 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bb7bcfdd6-bt6b9" podUID="433c8b4a-a004-4bda-9bdb-bccc5bce1f25" containerName="console" containerID="cri-o://08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd" gracePeriod=15 Jul 09 18:13:05.122612 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.122580 2573 generic.go:356] "Generic (PLEG): container finished" podID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerID="fba9dc1b949a6ab8109734eb340b6fdfdcd715e9a0e08248d56a52c60753a264" exitCode=0 Jul 09 18:13:05.122969 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.122663 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-h6p5l" event={"ID":"94d1cb45-dd84-4d2a-9fdd-197e829b8409","Type":"ContainerDied","Data":"fba9dc1b949a6ab8109734eb340b6fdfdcd715e9a0e08248d56a52c60753a264"} Jul 09 18:13:05.348812 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.348749 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:13:05.388992 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.388956 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-config\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389146 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389021 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d994k\" (UniqueName: \"kubernetes.io/projected/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-kube-api-access-d994k\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389146 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389066 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-serving-cert\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389146 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389092 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-oauth-serving-cert\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389373 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389196 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-trusted-ca-bundle\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389373 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389234 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-service-ca\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389373 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389259 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-oauth-config\") pod \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\" (UID: \"433c8b4a-a004-4bda-9bdb-bccc5bce1f25\") " Jul 09 18:13:05.389373 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389290 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-config" (OuterVolumeSpecName: "console-config") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:13:05.389601 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389537 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:05.389601 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389549 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:13:05.389601 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389561 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-service-ca" (OuterVolumeSpecName: "service-ca") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:13:05.389767 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.389609 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:13:05.391159 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.391131 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-kube-api-access-d994k" (OuterVolumeSpecName: "kube-api-access-d994k") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "kube-api-access-d994k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:13:05.391384 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.391360 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:13:05.391384 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.391375 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "433c8b4a-a004-4bda-9bdb-bccc5bce1f25" (UID: "433c8b4a-a004-4bda-9bdb-bccc5bce1f25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:13:05.490829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.490798 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:05.490829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.490826 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:05.490829 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.490836 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:05.491048 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.490847 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d994k\" (UniqueName: \"kubernetes.io/projected/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-kube-api-access-d994k\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:05.491048 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.490856 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:05.491048 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:05.490864 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/433c8b4a-a004-4bda-9bdb-bccc5bce1f25-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:13:06.130725 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.130676 2573 generic.go:356] "Generic (PLEG): container finished" podID="433c8b4a-a004-4bda-9bdb-bccc5bce1f25" containerID="08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd" exitCode=0 Jul 09 18:13:06.131136 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.130741 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb7bcfdd6-bt6b9" Jul 09 18:13:06.131136 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.130772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb7bcfdd6-bt6b9" event={"ID":"433c8b4a-a004-4bda-9bdb-bccc5bce1f25","Type":"ContainerDied","Data":"08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd"} Jul 09 18:13:06.131136 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.130838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb7bcfdd6-bt6b9" event={"ID":"433c8b4a-a004-4bda-9bdb-bccc5bce1f25","Type":"ContainerDied","Data":"a0447b68d910db83aa735b89ba4db676dec2eaa7da9c9b48fad75cbbf8ee6f7b"} Jul 09 18:13:06.131136 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.130869 2573 scope.go:117] "RemoveContainer" containerID="08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd" Jul 09 18:13:06.141562 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.141539 2573 scope.go:117] "RemoveContainer" containerID="08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd" Jul 09 18:13:06.141852 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:13:06.141828 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd\": container with ID starting with 08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd not found: ID does not exist" containerID="08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd" Jul 09 18:13:06.141946 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.141860 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd"} err="failed to get container status \"08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd\": rpc error: code = NotFound desc = could not find container \"08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd\": container with ID starting with 08e4be24745ac6e2d83eb7ddd8f57737661fb45ea88bbc8116cf1252206933bd not found: ID does not exist" Jul 09 18:13:06.155373 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.155348 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb7bcfdd6-bt6b9"] Jul 09 18:13:06.162627 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:06.162602 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bb7bcfdd6-bt6b9"] Jul 09 18:13:08.005755 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:08.005710 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="433c8b4a-a004-4bda-9bdb-bccc5bce1f25" path="/var/lib/kubelet/pods/433c8b4a-a004-4bda-9bdb-bccc5bce1f25/volumes" Jul 09 18:13:11.155704 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:11.155670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-h6p5l" event={"ID":"94d1cb45-dd84-4d2a-9fdd-197e829b8409","Type":"ContainerStarted","Data":"78ae105077bb783e317389cfda4aeb3eadc948fb85e7f0118d6da2471cc98524"} Jul 09 18:13:11.177077 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:13:11.177014 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-h6p5l" podStartSLOduration=2.855127811 podStartE2EDuration="13.176994058s" totalImagesPullingTime="8.926474141s" totalInitContainerRuntime="1.395392106s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:11.176797172 +0000 UTC m=+491.825951818" watchObservedRunningTime="2026-07-09 18:13:11.176994058 +0000 UTC m=+491.826148706" Jul 09 18:14:15.416743 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:15.416709 2573 generic.go:356] "Generic (PLEG): container finished" podID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerID="78ae105077bb783e317389cfda4aeb3eadc948fb85e7f0118d6da2471cc98524" exitCode=0 Jul 09 18:14:15.417138 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:15.416775 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-h6p5l" event={"ID":"94d1cb45-dd84-4d2a-9fdd-197e829b8409","Type":"ContainerDied","Data":"78ae105077bb783e317389cfda4aeb3eadc948fb85e7f0118d6da2471cc98524"} Jul 09 18:14:16.550679 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.550654 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-h6p5l" Jul 09 18:14:16.706586 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.706489 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbrzv\" (UniqueName: \"kubernetes.io/projected/94d1cb45-dd84-4d2a-9fdd-197e829b8409-kube-api-access-nbrzv\") pod \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " Jul 09 18:14:16.706586 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.706555 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94d1cb45-dd84-4d2a-9fdd-197e829b8409-model-cache\") pod \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\" (UID: \"94d1cb45-dd84-4d2a-9fdd-197e829b8409\") " Jul 09 18:14:16.708759 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.708729 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d1cb45-dd84-4d2a-9fdd-197e829b8409-kube-api-access-nbrzv" (OuterVolumeSpecName: "kube-api-access-nbrzv") pod "94d1cb45-dd84-4d2a-9fdd-197e829b8409" (UID: "94d1cb45-dd84-4d2a-9fdd-197e829b8409"). InnerVolumeSpecName "kube-api-access-nbrzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:14:16.724934 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.724907 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d1cb45-dd84-4d2a-9fdd-197e829b8409-model-cache" (OuterVolumeSpecName: "model-cache") pod "94d1cb45-dd84-4d2a-9fdd-197e829b8409" (UID: "94d1cb45-dd84-4d2a-9fdd-197e829b8409"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:14:16.807878 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.807844 2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94d1cb45-dd84-4d2a-9fdd-197e829b8409-model-cache\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:14:16.807878 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:16.807871 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbrzv\" (UniqueName: \"kubernetes.io/projected/94d1cb45-dd84-4d2a-9fdd-197e829b8409-kube-api-access-nbrzv\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:14:17.425414 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:17.425387 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-h6p5l" Jul 09 18:14:17.425602 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:17.425386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-h6p5l" event={"ID":"94d1cb45-dd84-4d2a-9fdd-197e829b8409","Type":"ContainerDied","Data":"392c285665da83df5ab7d3b4c0bbed16b32203c8f8d773c2a59cabe4fa6bf0ce"} Jul 09 18:14:17.425602 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:17.425499 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="392c285665da83df5ab7d3b4c0bbed16b32203c8f8d773c2a59cabe4fa6bf0ce" Jul 09 18:14:59.782314 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:59.782275 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:14:59.783086 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:14:59.783066 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:19:59.814996 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:19:59.814909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:19:59.816772 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:19:59.816749 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:24:59.842119 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:24:59.842090 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:24:59.846383 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:24:59.846365 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:29:45.944181 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944149 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xb29k/must-gather-gxslp"] Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944507 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerName="download-hf-model" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944519 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerName="download-hf-model" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944530 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="433c8b4a-a004-4bda-9bdb-bccc5bce1f25" containerName="console" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944536 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="433c8b4a-a004-4bda-9bdb-bccc5bce1f25" containerName="console" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944547 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerName="s3-init" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944552 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerName="s3-init" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944600 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d1cb45-dd84-4d2a-9fdd-197e829b8409" containerName="s3-init" Jul 09 18:29:45.944660 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.944609 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="433c8b4a-a004-4bda-9bdb-bccc5bce1f25" containerName="console" Jul 09 18:29:45.946946 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.946930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:45.950049 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.950025 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xb29k\"/\"default-dockercfg-vp9dp\"" Jul 09 18:29:45.950144 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.950025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xb29k\"/\"kube-root-ca.crt\"" Jul 09 18:29:45.951167 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.951144 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xb29k\"/\"openshift-service-ca.crt\"" Jul 09 18:29:45.955769 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:45.955748 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xb29k/must-gather-gxslp"] Jul 09 18:29:46.048138 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.048109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhfgd\" (UniqueName: \"kubernetes.io/projected/e292f201-3c63-47f1-96e2-9985211fdc2a-kube-api-access-fhfgd\") pod \"must-gather-gxslp\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.048317 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.048166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e292f201-3c63-47f1-96e2-9985211fdc2a-must-gather-output\") pod \"must-gather-gxslp\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.149379 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.149341 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhfgd\" (UniqueName: \"kubernetes.io/projected/e292f201-3c63-47f1-96e2-9985211fdc2a-kube-api-access-fhfgd\") pod \"must-gather-gxslp\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.149556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.149404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e292f201-3c63-47f1-96e2-9985211fdc2a-must-gather-output\") pod \"must-gather-gxslp\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.149721 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.149705 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e292f201-3c63-47f1-96e2-9985211fdc2a-must-gather-output\") pod \"must-gather-gxslp\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.158487 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.158444 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhfgd\" (UniqueName: \"kubernetes.io/projected/e292f201-3c63-47f1-96e2-9985211fdc2a-kube-api-access-fhfgd\") pod \"must-gather-gxslp\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.271146 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.271052 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:29:46.403747 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.403719 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xb29k/must-gather-gxslp"] Jul 09 18:29:46.403747 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:29:46.403734 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode292f201_3c63_47f1_96e2_9985211fdc2a.slice/crio-12c9323e2abdb66b24950c5f298b8de34a0c0dacd2e9901f68b6c67d1c988d7a WatchSource:0}: Error finding container 12c9323e2abdb66b24950c5f298b8de34a0c0dacd2e9901f68b6c67d1c988d7a: Status 404 returned error can't find the container with id 12c9323e2abdb66b24950c5f298b8de34a0c0dacd2e9901f68b6c67d1c988d7a Jul 09 18:29:46.405656 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:46.405641 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 18:29:47.256133 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:47.256067 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xb29k/must-gather-gxslp" event={"ID":"e292f201-3c63-47f1-96e2-9985211fdc2a","Type":"ContainerStarted","Data":"12c9323e2abdb66b24950c5f298b8de34a0c0dacd2e9901f68b6c67d1c988d7a"} Jul 09 18:29:53.287975 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:53.287940 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xb29k/must-gather-gxslp" event={"ID":"e292f201-3c63-47f1-96e2-9985211fdc2a","Type":"ContainerStarted","Data":"eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1"} Jul 09 18:29:53.288413 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:53.287988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xb29k/must-gather-gxslp" event={"ID":"e292f201-3c63-47f1-96e2-9985211fdc2a","Type":"ContainerStarted","Data":"d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206"} Jul 09 18:29:53.305961 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:53.305898 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xb29k/must-gather-gxslp" podStartSLOduration=2.316766325 podStartE2EDuration="8.305879241s" totalImagesPullingTime="5.989112916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:29:53.304667053 +0000 UTC m=+1493.953821700" watchObservedRunningTime="2026-07-09 18:29:53.305879241 +0000 UTC m=+1493.955033892" Jul 09 18:29:59.875777 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:59.875694 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:29:59.878519 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:29:59.878497 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:30:11.374341 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:11.374308 2573 generic.go:356] "Generic (PLEG): container finished" podID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerID="d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206" exitCode=0 Jul 09 18:30:11.374871 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:11.374383 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xb29k/must-gather-gxslp" event={"ID":"e292f201-3c63-47f1-96e2-9985211fdc2a","Type":"ContainerDied","Data":"d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206"} Jul 09 18:30:11.374871 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:11.374815 2573 scope.go:117] "RemoveContainer" containerID="d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206" Jul 09 18:30:11.906354 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:11.906328 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xb29k_must-gather-gxslp_e292f201-3c63-47f1-96e2-9985211fdc2a/gather/0.log" Jul 09 18:30:15.360328 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:15.360279 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hz6fn_69e420c6-bf61-46ff-a147-9b5b653a237a/global-pull-secret-syncer/0.log" Jul 09 18:30:15.514288 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:15.514253 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7d6t2_9d5672ed-fabe-44ba-bc52-63ca5967df2c/konnectivity-agent/0.log" Jul 09 18:30:15.594341 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:15.594286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-186.ec2.internal_3a99e495f424a8870814d989f4c4e9e7/haproxy/0.log" Jul 09 18:30:17.294963 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.294927 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xb29k/must-gather-gxslp"] Jul 09 18:30:17.295543 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.295203 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xb29k/must-gather-gxslp" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="copy" containerID="cri-o://eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1" gracePeriod=2 Jul 09 18:30:17.298277 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:30:17.298232 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gxslp\" is forbidden: User \"system:node:ip-10-0-138-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xb29k\": no relationship found between node 'ip-10-0-138-186.ec2.internal' and this object" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:30:17.298672 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.298648 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xb29k/must-gather-gxslp"] Jul 09 18:30:17.527206 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.527182 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xb29k_must-gather-gxslp_e292f201-3c63-47f1-96e2-9985211fdc2a/copy/0.log" Jul 09 18:30:17.528943 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.528927 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:30:17.531328 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:30:17.531307 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gxslp\" is forbidden: User \"system:node:ip-10-0-138-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xb29k\": no relationship found between node 'ip-10-0-138-186.ec2.internal' and this object" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:30:17.657064 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.656981 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e292f201-3c63-47f1-96e2-9985211fdc2a-must-gather-output\") pod \"e292f201-3c63-47f1-96e2-9985211fdc2a\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " Jul 09 18:30:17.657203 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.657085 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhfgd\" (UniqueName: \"kubernetes.io/projected/e292f201-3c63-47f1-96e2-9985211fdc2a-kube-api-access-fhfgd\") pod \"e292f201-3c63-47f1-96e2-9985211fdc2a\" (UID: \"e292f201-3c63-47f1-96e2-9985211fdc2a\") " Jul 09 18:30:17.657990 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.657961 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292f201-3c63-47f1-96e2-9985211fdc2a-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e292f201-3c63-47f1-96e2-9985211fdc2a" (UID: "e292f201-3c63-47f1-96e2-9985211fdc2a"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:30:17.659237 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.659218 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e292f201-3c63-47f1-96e2-9985211fdc2a-kube-api-access-fhfgd" (OuterVolumeSpecName: "kube-api-access-fhfgd") pod "e292f201-3c63-47f1-96e2-9985211fdc2a" (UID: "e292f201-3c63-47f1-96e2-9985211fdc2a"). InnerVolumeSpecName "kube-api-access-fhfgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:30:17.758480 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.758432 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhfgd\" (UniqueName: \"kubernetes.io/projected/e292f201-3c63-47f1-96e2-9985211fdc2a-kube-api-access-fhfgd\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:30:17.758480 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:17.758477 2573 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e292f201-3c63-47f1-96e2-9985211fdc2a-must-gather-output\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" Jul 09 18:30:18.003760 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.003731 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" path="/var/lib/kubelet/pods/e292f201-3c63-47f1-96e2-9985211fdc2a/volumes" Jul 09 18:30:18.403210 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.403139 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xb29k_must-gather-gxslp_e292f201-3c63-47f1-96e2-9985211fdc2a/copy/0.log" Jul 09 18:30:18.403623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.403551 2573 generic.go:356] "Generic (PLEG): container finished" podID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerID="eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1" exitCode=143 Jul 09 18:30:18.403623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.403599 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xb29k/must-gather-gxslp" Jul 09 18:30:18.403623 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.403606 2573 scope.go:117] "RemoveContainer" containerID="eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1" Jul 09 18:30:18.413614 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.413583 2573 scope.go:117] "RemoveContainer" containerID="d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206" Jul 09 18:30:18.426435 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.426420 2573 scope.go:117] "RemoveContainer" containerID="eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1" Jul 09 18:30:18.426715 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:30:18.426697 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1\": container with ID starting with eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1 not found: ID does not exist" containerID="eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1" Jul 09 18:30:18.426770 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.426723 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1"} err="failed to get container status \"eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1\": rpc error: code = NotFound desc = could not find container \"eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1\": container with ID starting with eacd1916300fba55293831f551b92d3a472166da7a1d3e5ef3251ec67faea8f1 not found: ID does not exist" Jul 09 18:30:18.426770 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.426741 2573 scope.go:117] "RemoveContainer" containerID="d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206" Jul 09 18:30:18.426963 ip-10-0-138-186 kubenswrapper[2573]: E0709 18:30:18.426947 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206\": container with ID starting with d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206 not found: ID does not exist" containerID="d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206" Jul 09 18:30:18.427007 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:18.426967 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206"} err="failed to get container status \"d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206\": rpc error: code = NotFound desc = could not find container \"d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206\": container with ID starting with d9652de1488369602a95c150254032eea908432d25515abba468aa05b5143206 not found: ID does not exist" Jul 09 18:30:19.253810 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.253779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/alertmanager/0.log" Jul 09 18:30:19.284415 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.284389 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/config-reloader/0.log" Jul 09 18:30:19.331707 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.331684 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/kube-rbac-proxy-web/0.log" Jul 09 18:30:19.369329 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.369306 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/kube-rbac-proxy/0.log" Jul 09 18:30:19.412157 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.412134 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/kube-rbac-proxy-metric/0.log" Jul 09 18:30:19.450855 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.450830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/prom-label-proxy/0.log" Jul 09 18:30:19.477188 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.477167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_376a9448-2ea0-46ea-829c-c7852b75db42/init-config-reloader/0.log" Jul 09 18:30:19.561322 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.561267 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4zr7p_8e7756f7-a36b-49be-887c-ab6356227b77/kube-state-metrics/0.log" Jul 09 18:30:19.588535 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.588511 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4zr7p_8e7756f7-a36b-49be-887c-ab6356227b77/kube-rbac-proxy-main/0.log" Jul 09 18:30:19.617854 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.617834 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4zr7p_8e7756f7-a36b-49be-887c-ab6356227b77/kube-rbac-proxy-self/0.log" Jul 09 18:30:19.654287 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.654271 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fdb467dc8-6nll6_54d72537-2f32-4d57-8a4e-b86519dc0d72/metrics-server/0.log" Jul 09 18:30:19.689293 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.689272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bbdv6_6329b008-cf4f-4373-9467-ebbc0991e5e9/monitoring-plugin/0.log" Jul 09 18:30:19.832989 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.832919 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-blfvg_722ecfba-1de0-4e94-a306-577a58500178/node-exporter/0.log" Jul 09 18:30:19.860679 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.860660 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-blfvg_722ecfba-1de0-4e94-a306-577a58500178/kube-rbac-proxy/0.log" Jul 09 18:30:19.910727 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:19.909443 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-blfvg_722ecfba-1de0-4e94-a306-577a58500178/init-textfile/0.log" Jul 09 18:30:20.035681 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.035655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tqn76_54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606/kube-rbac-proxy-main/0.log" Jul 09 18:30:20.062399 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.062374 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tqn76_54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606/kube-rbac-proxy-self/0.log" Jul 09 18:30:20.090871 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.090813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tqn76_54e9c8d5-65c6-4ba9-a2cc-e2ca6ed81606/openshift-state-metrics/0.log" Jul 09 18:30:20.158371 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.158351 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/prometheus/0.log" Jul 09 18:30:20.178930 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.178911 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/config-reloader/0.log" Jul 09 18:30:20.206532 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.206516 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/thanos-sidecar/0.log" Jul 09 18:30:20.232286 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.232268 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/kube-rbac-proxy-web/0.log" Jul 09 18:30:20.255590 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.255572 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/kube-rbac-proxy/0.log" Jul 09 18:30:20.282257 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.282240 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/kube-rbac-proxy-thanos/0.log" Jul 09 18:30:20.311932 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.311915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd16f6b-07b3-4bd5-80ee-f4c1612302a5/init-config-reloader/0.log" Jul 09 18:30:20.343766 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.343701 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nwql5_690d812e-a611-446c-8b76-b6acf313a162/prometheus-operator/0.log" Jul 09 18:30:20.375432 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.375409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nwql5_690d812e-a611-446c-8b76-b6acf313a162/kube-rbac-proxy/0.log" Jul 09 18:30:20.451130 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.451104 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5456c4f45b-dghdx_6448a983-9e7f-4599-947d-6d55d93ba40a/telemeter-client/0.log" Jul 09 18:30:20.484486 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.484465 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5456c4f45b-dghdx_6448a983-9e7f-4599-947d-6d55d93ba40a/reload/0.log" Jul 09 18:30:20.512558 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.512536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5456c4f45b-dghdx_6448a983-9e7f-4599-947d-6d55d93ba40a/kube-rbac-proxy/0.log" Jul 09 18:30:20.556862 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.556841 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df55bf5b-l8scg_9c6b325a-57d8-479b-a8ce-f577d939aa3b/thanos-query/0.log" Jul 09 18:30:20.584067 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.584047 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df55bf5b-l8scg_9c6b325a-57d8-479b-a8ce-f577d939aa3b/kube-rbac-proxy-web/0.log" Jul 09 18:30:20.612108 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.612052 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df55bf5b-l8scg_9c6b325a-57d8-479b-a8ce-f577d939aa3b/kube-rbac-proxy/0.log" Jul 09 18:30:20.637904 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.637888 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df55bf5b-l8scg_9c6b325a-57d8-479b-a8ce-f577d939aa3b/prom-label-proxy/0.log" Jul 09 18:30:20.669008 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.668985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df55bf5b-l8scg_9c6b325a-57d8-479b-a8ce-f577d939aa3b/kube-rbac-proxy-rules/0.log" Jul 09 18:30:20.693502 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:20.693484 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df55bf5b-l8scg_9c6b325a-57d8-479b-a8ce-f577d939aa3b/kube-rbac-proxy-metrics/0.log" Jul 09 18:30:22.971197 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:22.971170 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54887fbfcd-dd5t9_96c7e396-7aed-4de1-9bea-b51612e2ed1a/console/0.log" Jul 09 18:30:23.705673 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.705641 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49"] Jul 09 18:30:23.706054 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.706041 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="gather" Jul 09 18:30:23.706097 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.706056 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="gather" Jul 09 18:30:23.706097 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.706066 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="copy" Jul 09 18:30:23.706097 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.706072 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="copy" Jul 09 18:30:23.706201 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.706143 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="gather" Jul 09 18:30:23.706201 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.706151 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e292f201-3c63-47f1-96e2-9985211fdc2a" containerName="copy" Jul 09 18:30:23.708534 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.708519 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.713762 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.713673 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cf7pf\"/\"openshift-service-ca.crt\"" Jul 09 18:30:23.713946 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.713928 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cf7pf\"/\"kube-root-ca.crt\"" Jul 09 18:30:23.715681 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.715656 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cf7pf\"/\"default-dockercfg-4l96w\"" Jul 09 18:30:23.725993 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.725968 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49"] Jul 09 18:30:23.810229 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.810185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-sys\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.810412 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.810290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-lib-modules\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.810412 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.810327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-proc\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.810412 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.810366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-podres\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.810571 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.810432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnchm\" (UniqueName: \"kubernetes.io/projected/1d508a70-fdee-418c-9220-367094a87d5c-kube-api-access-gnchm\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911639 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnchm\" (UniqueName: \"kubernetes.io/projected/1d508a70-fdee-418c-9220-367094a87d5c-kube-api-access-gnchm\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911778 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-sys\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911778 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-lib-modules\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911778 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-proc\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911778 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-podres\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911922 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911805 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-sys\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911922 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911881 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-podres\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911922 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911881 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-lib-modules\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.911922 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.911883 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d508a70-fdee-418c-9220-367094a87d5c-proc\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:23.920738 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:23.920701 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnchm\" (UniqueName: \"kubernetes.io/projected/1d508a70-fdee-418c-9220-367094a87d5c-kube-api-access-gnchm\") pod \"perf-node-gather-daemonset-h7x49\" (UID: \"1d508a70-fdee-418c-9220-367094a87d5c\") " pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:24.019584 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.019501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:24.151057 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.151033 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49"] Jul 09 18:30:24.153719 ip-10-0-138-186 kubenswrapper[2573]: W0709 18:30:24.153686 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d508a70_fdee_418c_9220_367094a87d5c.slice/crio-9f7d7ba21185a7b08e1812038a9ed4ed9ed7e7928db3cdcf9d9b1976bce6cf06 WatchSource:0}: Error finding container 9f7d7ba21185a7b08e1812038a9ed4ed9ed7e7928db3cdcf9d9b1976bce6cf06: Status 404 returned error can't find the container with id 9f7d7ba21185a7b08e1812038a9ed4ed9ed7e7928db3cdcf9d9b1976bce6cf06 Jul 09 18:30:24.430867 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.430833 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" event={"ID":"1d508a70-fdee-418c-9220-367094a87d5c","Type":"ContainerStarted","Data":"ae2e61c16bd5ae82e6656c4011ad2adc71bc0f53549d5c961b9ba61430263831"} Jul 09 18:30:24.431058 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.430883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" event={"ID":"1d508a70-fdee-418c-9220-367094a87d5c","Type":"ContainerStarted","Data":"9f7d7ba21185a7b08e1812038a9ed4ed9ed7e7928db3cdcf9d9b1976bce6cf06"} Jul 09 18:30:24.431058 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.430935 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:24.452124 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.452074 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" podStartSLOduration=1.452058622 podStartE2EDuration="1.452058622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:24.450936896 +0000 UTC m=+1525.100091546" watchObservedRunningTime="2026-07-09 18:30:24.452058622 +0000 UTC m=+1525.101213268" Jul 09 18:30:24.588253 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.588222 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27zzq_90c48ae0-5b80-4019-96a9-261e34633226/dns/0.log" Jul 09 18:30:24.611330 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.611307 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27zzq_90c48ae0-5b80-4019-96a9-261e34633226/kube-rbac-proxy/0.log" Jul 09 18:30:24.743380 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:24.743291 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-86drl_de8dcaac-1020-4c71-8277-1779fe212d84/dns-node-resolver/0.log" Jul 09 18:30:25.351236 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:25.351212 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xgr7h_13acb9ea-6fda-4ab1-8fb7-f6fbcc39d683/node-ca/0.log" Jul 09 18:30:26.560793 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:26.560764 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-st8cw_225fb693-c1e1-42be-9cda-b113e86894ab/serve-healthcheck-canary/0.log" Jul 09 18:30:26.974564 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:26.974537 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cx2h4_b957ac53-29f9-4315-9728-e39db265e3a0/kube-rbac-proxy/0.log" Jul 09 18:30:27.003322 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:27.003295 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cx2h4_b957ac53-29f9-4315-9728-e39db265e3a0/exporter/0.log" Jul 09 18:30:27.028597 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:27.028570 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cx2h4_b957ac53-29f9-4315-9728-e39db265e3a0/extractor/0.log" Jul 09 18:30:29.377834 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:29.377805 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-57b57d8c6-tkjxq_a68fd682-932c-41ee-9137-8300cc729d92/manager/0.log" Jul 09 18:30:29.559847 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:29.559815 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-h6p5l_94d1cb45-dd84-4d2a-9fdd-197e829b8409/s3-init/0.log" Jul 09 18:30:29.577928 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:29.577904 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-h6p5l_94d1cb45-dd84-4d2a-9fdd-197e829b8409/download-hf-model/0.log" Jul 09 18:30:29.608127 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:29.608097 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-t5r58_219396a3-ee06-424d-88ef-ef4cc7f7aa81/seaweedfs/0.log" Jul 09 18:30:30.444226 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:30.444200 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cf7pf/perf-node-gather-daemonset-h7x49" Jul 09 18:30:35.558374 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.558297 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/kube-multus-additional-cni-plugins/0.log" Jul 09 18:30:35.584183 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.584156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/egress-router-binary-copy/0.log" Jul 09 18:30:35.607218 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.607189 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/cni-plugins/0.log" Jul 09 18:30:35.630842 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.630815 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/bond-cni-plugin/0.log" Jul 09 18:30:35.653195 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.653168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/routeoverride-cni/0.log" Jul 09 18:30:35.679455 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.679434 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/whereabouts-cni-bincopy/0.log" Jul 09 18:30:35.702564 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.702538 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbnmz_c3d712b2-606f-49cd-9ae8-ddfe017f732d/whereabouts-cni/0.log" Jul 09 18:30:35.739613 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.739590 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qqh66_4533e635-e32d-47e1-acb9-66901d8ddec4/kube-multus/0.log" Jul 09 18:30:35.761556 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.761533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7qkqj_bc406faa-9889-40ca-8c35-9b70d78bc8ca/network-metrics-daemon/0.log" Jul 09 18:30:35.786029 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:35.786006 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7qkqj_bc406faa-9889-40ca-8c35-9b70d78bc8ca/kube-rbac-proxy/0.log" Jul 09 18:30:37.125203 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.125175 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-controller/0.log" Jul 09 18:30:37.150241 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.150215 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/1.log" Jul 09 18:30:37.150400 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.150317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovn-acl-logging/0.log" Jul 09 18:30:37.172655 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.172632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/kube-rbac-proxy-node/0.log" Jul 09 18:30:37.210530 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.210507 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 18:30:37.251039 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.251013 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/northd/0.log" Jul 09 18:30:37.303483 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.303457 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/nbdb/0.log" Jul 09 18:30:37.355848 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.355828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/sbdb/0.log" Jul 09 18:30:37.398595 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:37.398534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7s8z_8688453f-fca7-4ea0-8f02-d601b383693e/ovnkube-controller/0.log" Jul 09 18:30:38.532787 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:38.532754 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-p2j48_a421478f-4388-4cbe-aada-bc3f0e638fec/network-check-target-container/0.log" Jul 09 18:30:39.479699 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:39.479665 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bt5tf_7c4d13bc-0664-47b3-a939-36e068cc14f4/iptables-alerter/0.log" Jul 09 18:30:40.209761 ip-10-0-138-186 kubenswrapper[2573]: I0709 18:30:40.209733 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2f7hk_38338cd5-5bb7-4c99-8a1b-b22abf30b40c/tuned/0.log"