Jul 06 20:34:43.058825 ip-10-0-130-92 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:34:43.453948 ip-10-0-130-92 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:34:43.453948 ip-10-0-130-92 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:34:43.453948 ip-10-0-130-92 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:34:43.453948 ip-10-0-130-92 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:34:43.453948 ip-10-0-130-92 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:34:43.455165 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.455074 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:34:43.459638 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459621 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:43.459638 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459638 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459641 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459644 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459656 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459659 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459662 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459664 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459667 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459670 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459673 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459675 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459678 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459681 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459683 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459686 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459688 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459691 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459694 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459696 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459699 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:43.459713 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459702 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459704 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459706 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459711 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459715 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459718 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459720 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459723 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459725 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459728 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459730 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459733 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459735 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459737 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459739 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459742 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459745 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459747 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459749 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:43.460164 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459752 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459754 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459756 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459758 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459761 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459763 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459765 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459767 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459771 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459773 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459775 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459777 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459781 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459784 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459787 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459791 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459794 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459796 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459799 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459801 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:43.460641 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459804 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459806 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459808 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459811 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459813 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459816 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459818 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459820 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459823 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459825 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459828 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459830 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459833 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459837 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459840 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459842 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459845 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459848 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459851 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:43.461142 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459854 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459856 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459859 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459861 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459863 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459866 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459868 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459870 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459874 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459876 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459879 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459881 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459883 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459886 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459888 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459890 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459893 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459895 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459897 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.459900 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:43.461598 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460626 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460633 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460636 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460639 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460643 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460646 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460648 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460653 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460656 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460659 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460662 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460664 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460667 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460669 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460672 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460675 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460678 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460681 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:43.462106 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460684 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460686 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460690 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460693 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460695 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460698 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460700 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460703 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460705 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460708 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460710 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460714 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460716 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460718 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460720 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460723 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460725 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460727 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460730 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460733 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:43.462550 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460735 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460737 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460740 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460742 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460744 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460747 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460749 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460751 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460754 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460756 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460759 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460762 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460765 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460768 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460772 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460776 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460779 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460782 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460784 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460786 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:43.463155 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460789 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460791 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460793 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460795 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460798 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460800 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460802 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460804 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460807 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460809 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460811 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460814 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460817 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460819 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460821 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460824 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460826 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460828 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460830 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460833 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:43.463656 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460835 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460837 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460840 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460842 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460844 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460846 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460849 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460852 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460855 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460857 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460860 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460862 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460864 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460867 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460869 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460872 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460874 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460876 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460878 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460881 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:43.464128 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.460883 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461258 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461262 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461266 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461271 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461273 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461276 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461278 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461281 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461283 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461286 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461288 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461291 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461293 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461295 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461298 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461300 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461302 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461305 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461308 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:43.464633 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461310 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461313 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461316 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461318 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461320 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461323 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461325 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461327 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461330 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461332 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461334 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461337 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461339 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461341 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461344 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461346 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461348 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461351 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461353 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461356 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:43.465097 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461358 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461360 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461363 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461365 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461368 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461370 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461373 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461375 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461377 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461380 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461382 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461385 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461387 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461389 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461392 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461394 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461397 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461400 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461402 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:43.465584 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461404 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461407 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461409 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461411 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461414 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461416 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461419 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461421 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461423 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461426 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461428 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461430 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461433 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461435 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461437 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461440 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461444 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461447 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461449 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461452 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:43.466047 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461454 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461457 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461459 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461462 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461466 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461470 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461472 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461475 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461478 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461480 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461483 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461485 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461488 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461490 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461495 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461499 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461501 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461504 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:43.466536 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461507 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.461510 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461606 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461617 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461627 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461634 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461638 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461641 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461645 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461651 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461654 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461657 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461660 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461664 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461667 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461669 2578 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461672 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461675 2578 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461678 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461680 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461684 2578 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461687 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461690 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461693 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:34:43.466977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461696 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461699 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461702 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461705 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461708 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461711 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461713 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461716 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461719 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461724 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461728 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461731 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461733 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461736 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461739 2578 flags.go:64] FLAG: --enable-server="true" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461742 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461750 2578 flags.go:64] FLAG: --event-burst="100" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461754 2578 flags.go:64] FLAG: --event-qps="50" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461756 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461759 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461762 2578 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461770 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461772 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461775 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461778 2578 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:34:43.467558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461780 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461783 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461786 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461788 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461791 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461794 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461796 2578 flags.go:64] FLAG: --feature-gates="" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461800 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461803 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461806 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461809 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461812 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461815 2578 flags.go:64] FLAG: --help="false" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461817 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461821 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461823 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461827 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461830 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461833 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461836 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461839 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461841 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461844 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:34:43.468166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461847 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461852 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461854 2578 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461857 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461860 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461862 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461865 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461867 2578 flags.go:64] FLAG: --lock-file="" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461877 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461880 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461883 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461888 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461891 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461893 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461896 2578 flags.go:64] FLAG: --logging-format="text" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461899 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461902 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461905 2578 flags.go:64] FLAG: --manifest-url="" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461908 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461912 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461915 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461919 2578 flags.go:64] FLAG: --max-pods="110" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461921 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461924 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461927 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:34:43.468874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461931 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461934 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461937 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461940 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461947 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461949 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461952 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461956 2578 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461960 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461965 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461968 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461970 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461973 2578 flags.go:64] FLAG: --port="10250" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461976 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461979 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078a461badc2354e3" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461982 2578 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461984 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461987 2578 flags.go:64] FLAG: --register-node="true" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461990 2578 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461993 2578 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461996 2578 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.461999 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462001 2578 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462005 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462008 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:34:43.469796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462010 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462013 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462015 2578 flags.go:64] FLAG: --runonce="false" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462018 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462021 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462023 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462026 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462028 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462033 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462036 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462038 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462041 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462043 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462046 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462049 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462053 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462056 2578 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462059 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462065 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462067 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462070 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462074 2578 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462076 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462079 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462081 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:34:43.470483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462084 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462087 2578 flags.go:64] FLAG: --v="2" Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462090 2578 flags.go:64] FLAG: --version="false" Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462094 2578 flags.go:64] FLAG: --vmodule="" Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462098 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462101 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462217 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462221 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462224 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462226 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462229 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462231 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462234 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462236 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462238 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462242 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462244 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462246 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462249 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462251 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462254 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:43.471191 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462256 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462259 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462262 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462265 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462267 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462270 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462272 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462274 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462277 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462279 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462281 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462283 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462286 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462289 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462291 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462293 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462295 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462298 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462300 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462302 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:43.471860 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462305 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462307 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462310 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462312 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462314 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462317 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462320 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462323 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462326 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462328 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462330 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462333 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462335 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462338 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462341 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462344 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462347 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462349 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462351 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:43.472415 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462354 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462357 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462361 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462364 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462366 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462368 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462370 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462373 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462375 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462378 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462380 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462382 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462385 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462387 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462391 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462394 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462397 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462400 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462403 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462406 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:43.472918 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462409 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462411 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462414 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462416 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462419 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462421 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462425 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462427 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462429 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462432 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462435 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462437 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462441 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462443 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462446 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462449 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462451 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462454 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462457 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:43.473394 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462459 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462462 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462464 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462467 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462469 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.462472 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.462973 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.470874 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.470890 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.471585 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.471592 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471655 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471660 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471664 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471666 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:43.473875 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471669 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471672 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471674 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471677 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471680 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471682 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471685 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471688 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471691 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471693 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471696 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471698 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471701 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471703 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471706 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471708 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471711 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471714 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471716 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471719 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:43.474253 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471721 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471724 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471726 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471730 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471734 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471737 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471739 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471742 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471744 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471747 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471750 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471752 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471755 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471757 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471759 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471762 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471766 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471769 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471772 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:43.474741 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471775 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471778 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471781 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471784 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471787 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471789 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471794 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471797 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471800 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471804 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471807 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471810 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471813 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471815 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471818 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471821 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471823 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471826 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:43.475212 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471829 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471832 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471834 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471837 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471839 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471842 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471844 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471846 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471848 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471851 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471853 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471856 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471858 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471861 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471864 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471866 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471869 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471873 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471876 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471879 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:43.475678 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471882 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471884 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471886 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471889 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471892 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471894 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471896 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471899 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471901 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471904 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471906 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471909 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471911 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471914 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471917 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471919 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:43.476172 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.471922 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.471927 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472047 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472052 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472055 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472057 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472060 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472062 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472065 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472068 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472070 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472073 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472075 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472077 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472082 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:43.476567 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472086 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472089 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472091 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472094 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472097 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472100 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472103 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472105 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472108 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472110 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472114 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472116 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472119 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472122 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472124 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472127 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472129 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472132 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472134 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472136 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:43.476928 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472139 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472141 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472143 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472146 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472148 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472151 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472154 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472156 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472159 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472161 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472164 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472167 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472170 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472173 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472175 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472177 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472180 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472183 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472185 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472188 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:43.477400 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472190 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472193 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472195 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472198 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472200 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472202 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472205 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472207 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472210 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472212 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472214 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472217 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472219 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472221 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472224 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472226 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472228 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472230 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472233 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:43.477898 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472235 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472237 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472240 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472242 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472246 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472249 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472251 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472254 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472256 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472259 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472261 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472275 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472278 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472281 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472285 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472288 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472291 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472294 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472297 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:43.478344 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472299 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472302 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472304 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472307 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472309 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472312 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472314 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:43.472317 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.472321 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.472435 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.474558 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.475969 2578 server.go:1019] "Starting client certificate rotation" Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.476076 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:34:43.478804 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.476116 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:34:43.479119 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.478511 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:34:43.482131 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.482109 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:34:43.491634 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.491615 2578 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:34:43.493891 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.493863 2578 log.go:25] "Validated CRI v1 image API" Jul 06 20:34:43.497027 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.497011 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:34:43.500547 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.500506 2578 fs.go:135] Filesystem UUIDs: map[0546c4be-074e-40de-b2d7-9f3f211cd60c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c4ebeceb-d387-454c-80c0-b3ac99b72536:/dev/nvme0n1p4] Jul 06 20:34:43.500602 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.500546 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:34:43.514160 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.514137 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:34:43.514766 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.514651 2578 manager.go:216] Machine: {Timestamp:2026-07-06 20:34:43.505735125 +0000 UTC m=+0.330039368 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3053113 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25b6dd0276dbc36e75ad164c692afa SystemUUID:ec25b6dd-0276-dbc3-6e75-ad164c692afa BootID:81fae442-85ee-42e3-a482-1c48f8048cb1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bf:39:c1:ae:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bf:39:c1:ae:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:e9:71:3b:65:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:34:43.514766 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.514766 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:34:43.514883 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.514872 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:34:43.518465 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.518432 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:34:43.518625 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.518470 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:34:43.519086 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.519077 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:34:43.519119 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.519089 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:34:43.519119 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.519096 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:34:43.519676 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.519666 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:34:43.520812 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.520801 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:34:43.523582 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.523569 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:34:43.523715 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.523706 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:34:43.523748 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.523740 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:34:43.523777 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.523761 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:34:43.523803 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.523787 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:34:43.523803 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.523801 2578 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:34:43.524548 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.524512 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:34:43.525483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.525455 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:34:43.525634 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.525501 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:34:43.527988 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.527962 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:34:43.529737 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.529724 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:34:43.529795 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.529753 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:34:43.530781 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.530769 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:34:43.530781 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.530785 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:34:43.530781 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.530790 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:34:43.530911 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.530796 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:34:43.530911 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.530804 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:34:43.530911 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.530809 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:34:43.531297 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.531289 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:34:43.531297 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.531297 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:34:43.531356 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.531303 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:34:43.531356 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.531309 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:34:43.531356 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.531317 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:34:43.531356 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.531324 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:34:43.532013 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.532004 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:34:43.532013 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.532013 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:34:43.535285 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.535272 2578 server.go:1268] "Started kubelet" Jul 06 20:34:43.535418 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.535385 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:34:43.535589 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.535558 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:34:43.535686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.535605 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:34:43.536662 ip-10-0-130-92 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:34:43.537723 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.537708 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:34:43.538904 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.538825 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:34:43.538904 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.538874 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:34:43.539010 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.538923 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:34:43.539061 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.539048 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:34:43.540623 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.540602 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:34:43.542847 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.542828 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:34:43.542954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.542942 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:34:43.543015 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.543003 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:43.543362 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.543330 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:34:43.543434 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.543348 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:34:43.543434 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.543373 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:34:43.543541 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.543501 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:34:43.543541 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.543509 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:34:43.545035 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545020 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:34:43.545035 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545036 2578 factory.go:55] Registering systemd factory Jul 06 20:34:43.545035 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545042 2578 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:34:43.545267 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545250 2578 factory.go:153] Registering CRI-O factory Jul 06 20:34:43.545267 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545265 2578 factory.go:223] Registration of the crio container factory successfully Jul 06 20:34:43.545422 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545308 2578 factory.go:103] Registering Raw factory Jul 06 20:34:43.545422 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545322 2578 manager.go:1196] Started watching for new ooms in manager Jul 06 20:34:43.545944 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.545933 2578 manager.go:349] Starting recovery of all containers Jul 06 20:34:43.548257 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.548229 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:34:43.548391 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.548312 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:34:43.552510 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.548251 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-92.ec2.internal.18bfcda46c2d3f31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-92.ec2.internal,UID:ip-10-0-130-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-92.ec2.internal,},FirstTimestamp:2026-07-06 20:34:43.535241009 +0000 UTC m=+0.359545311,LastTimestamp:2026-07-06 20:34:43.535241009 +0000 UTC m=+0.359545311,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-92.ec2.internal,}" Jul 06 20:34:43.559306 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.559250 2578 manager.go:354] Recovery completed Jul 06 20:34:43.563498 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.563482 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.565318 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.565372 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565332 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.565372 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565342 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.565858 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565844 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:34:43.565858 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565857 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:34:43.565986 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565849 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.565986 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.565881 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:34:43.566591 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.566572 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.566649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.566606 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.566649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.566619 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.567040 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.566961 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-92.ec2.internal.18bfcda46df836ea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-92.ec2.internal,UID:ip-10-0-130-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-92.ec2.internal,},FirstTimestamp:2026-07-06 20:34:43.565319914 +0000 UTC m=+0.389624160,LastTimestamp:2026-07-06 20:34:43.565319914 +0000 UTC m=+0.389624160,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-92.ec2.internal,}" Jul 06 20:34:43.567223 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.567212 2578 policy_none.go:49] "None policy: Start" Jul 06 20:34:43.567259 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.567229 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:34:43.567259 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.567239 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:34:43.568425 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.568341 2578 policy_none.go:47] "Start" Jul 06 20:34:43.568511 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.568453 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pfnv9" Jul 06 20:34:43.577430 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.577355 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-92.ec2.internal.18bfcda46df87a85 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-92.ec2.internal,UID:ip-10-0-130-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-92.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-92.ec2.internal,},FirstTimestamp:2026-07-06 20:34:43.565337221 +0000 UTC m=+0.389641464,LastTimestamp:2026-07-06 20:34:43.565337221 +0000 UTC m=+0.389641464,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-92.ec2.internal,}" Jul 06 20:34:43.577549 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.577497 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pfnv9" Jul 06 20:34:43.606164 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606147 2578 manager.go:337] "Starting Device Plugin manager" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.606182 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606193 2578 server.go:87] "Starting device plugin registration server" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606489 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606501 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606690 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606824 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.606832 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.607266 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:34:43.618890 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.607322 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:43.644795 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.644757 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:34:43.646101 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.646078 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:34:43.646220 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.646114 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:34:43.646220 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.646135 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:34:43.646220 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.646171 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:34:43.648308 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.648275 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:43.707473 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.707407 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.709334 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.709316 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.709439 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.709345 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.709439 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.709356 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.709439 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.709387 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.722449 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.722427 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.722575 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.722458 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-92.ec2.internal\": node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:43.746424 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.746387 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal"] Jul 06 20:34:43.746619 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.746471 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.747079 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.747060 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:43.747466 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.747450 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.747543 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.747482 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.747543 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.747496 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.749125 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749114 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.749277 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.749320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749291 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.749880 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749848 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.749991 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749890 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.749991 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749908 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.749991 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749909 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.749991 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749932 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.749991 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.749944 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.751198 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.751181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.751280 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.751211 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:43.751875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.751860 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:43.751974 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.751883 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:43.751974 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.751896 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:43.777397 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.777372 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-92.ec2.internal\" not found" node="ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.781681 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.781663 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-92.ec2.internal\" not found" node="ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.845529 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.845495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b574a658b6026d17b7636034f150900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal\" (UID: \"2b574a658b6026d17b7636034f150900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.845680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.845551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b574a658b6026d17b7636034f150900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal\" (UID: \"2b574a658b6026d17b7636034f150900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.845680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.845582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f4db311b901a006fd4141a884f57806-config\") pod \"kube-apiserver-proxy-ip-10-0-130-92.ec2.internal\" (UID: \"9f4db311b901a006fd4141a884f57806\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.847590 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.847571 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:43.946537 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.946496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b574a658b6026d17b7636034f150900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal\" (UID: \"2b574a658b6026d17b7636034f150900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.946713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.946552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b574a658b6026d17b7636034f150900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal\" (UID: \"2b574a658b6026d17b7636034f150900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.946713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.946584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f4db311b901a006fd4141a884f57806-config\") pod \"kube-apiserver-proxy-ip-10-0-130-92.ec2.internal\" (UID: \"9f4db311b901a006fd4141a884f57806\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.946713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.946595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b574a658b6026d17b7636034f150900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal\" (UID: \"2b574a658b6026d17b7636034f150900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.946713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.946611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f4db311b901a006fd4141a884f57806-config\") pod \"kube-apiserver-proxy-ip-10-0-130-92.ec2.internal\" (UID: \"9f4db311b901a006fd4141a884f57806\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.946713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:43.946598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b574a658b6026d17b7636034f150900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal\" (UID: \"2b574a658b6026d17b7636034f150900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:43.948576 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:43.948560 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.049442 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.049398 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.080593 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.080564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:44.084899 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.084587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" Jul 06 20:34:44.149949 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.149901 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.250462 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.250424 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.351008 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.350926 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.451497 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.451467 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.475680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.475649 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:34:44.476104 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.475804 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:34:44.552534 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.552488 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.579900 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.579860 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:29:44 +0000 UTC" deadline="2028-02-29 12:56:05.471168652 +0000 UTC" Jul 06 20:34:44.580065 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.579915 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14464h21m20.891276434s" Jul 06 20:34:44.619742 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:44.619711 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b574a658b6026d17b7636034f150900.slice/crio-3840532c0b42701f538f9a3c8f36889d041df173d7920d5a59a0a81ff7520fd0 WatchSource:0}: Error finding container 3840532c0b42701f538f9a3c8f36889d041df173d7920d5a59a0a81ff7520fd0: Status 404 returned error can't find the container with id 3840532c0b42701f538f9a3c8f36889d041df173d7920d5a59a0a81ff7520fd0 Jul 06 20:34:44.620256 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:44.620234 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4db311b901a006fd4141a884f57806.slice/crio-ac034edaac2f81965428f787b7c66b5efad229c3f6cd899e78469fe628169d6f WatchSource:0}: Error finding container ac034edaac2f81965428f787b7c66b5efad229c3f6cd899e78469fe628169d6f: Status 404 returned error can't find the container with id ac034edaac2f81965428f787b7c66b5efad229c3f6cd899e78469fe628169d6f Jul 06 20:34:44.625322 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.625308 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:34:44.650407 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.650355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" event={"ID":"2b574a658b6026d17b7636034f150900","Type":"ContainerStarted","Data":"3840532c0b42701f538f9a3c8f36889d041df173d7920d5a59a0a81ff7520fd0"} Jul 06 20:34:44.651431 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.651407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" event={"ID":"9f4db311b901a006fd4141a884f57806","Type":"ContainerStarted","Data":"ac034edaac2f81965428f787b7c66b5efad229c3f6cd899e78469fe628169d6f"} Jul 06 20:34:44.653554 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.653538 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.749962 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.749931 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:44.751141 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.751124 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:44.751237 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.751161 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:44.751237 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.751177 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:44.754446 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.754430 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.845437 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.845403 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:44.854749 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.854722 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:44.950891 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:44.950811 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:44.955439 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:44.955421 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:45.056208 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.056154 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-92.ec2.internal\" not found" Jul 06 20:34:45.085312 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.085288 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:45.143605 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.143551 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" Jul 06 20:34:45.167941 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.167913 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:34:45.169014 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.168999 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" Jul 06 20:34:45.180678 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.180656 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:34:45.525405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.525372 2578 apiserver.go:52] "Watching apiserver" Jul 06 20:34:45.534508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.534465 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:34:45.534910 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.534888 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf","openshift-image-registry/node-ca-qt77r","openshift-multus/multus-additional-cni-plugins-zpvlw","openshift-network-diagnostics/network-check-target-6vbfp","openshift-network-operator/iptables-alerter-z79rj","openshift-ovn-kubernetes/ovnkube-node-44lv8","kube-system/global-pull-secret-syncer-vvbsl","kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal","openshift-cluster-node-tuning-operator/tuned-n9r6x","openshift-dns/node-resolver-w7j9k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal","openshift-multus/multus-wwtt5","openshift-multus/network-metrics-daemon-qhwm8","kube-system/konnectivity-agent-94s42"] Jul 06 20:34:45.536636 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.536615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.536737 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.536707 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:45.538142 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.538120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:45.538249 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.538194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:45.539455 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.539436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.540765 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.540741 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:45.540878 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.540815 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:45.541859 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.541835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.543193 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.543175 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:34:45.543558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.543536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.545537 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.545515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.545675 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.545656 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:34:45.545745 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.545515 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gdcx6\"" Jul 06 20:34:45.545823 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.545528 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:34:45.546016 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.546001 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.546113 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.546096 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.546244 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.546230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:34:45.546335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.546322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.546703 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.546684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dw942\"" Jul 06 20:34:45.546843 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.546825 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.547122 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.547067 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.547107 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.548579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.548854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.548871 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8k8gd\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.548940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.548583 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.549553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.549732 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.550617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.551306 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7xwwc\"" Jul 06 20:34:45.552037 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.551328 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.553180 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.553158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.554416 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.554298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:34:45.554824 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.554449 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.554824 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.554538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.554824 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.554546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:34:45.555307 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-cnibin\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.555380 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79cp\" (UniqueName: \"kubernetes.io/projected/67fe2b29-f12f-4b3e-962b-54b660f54547-kube-api-access-d79cp\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.555380 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-var-lib-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555485 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-ovnkube-config\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555485 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p79s4\" (UniqueName: \"kubernetes.io/projected/f612ed61-569d-4c7b-9b2b-c5b60441774a-kube-api-access-p79s4\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.555581 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-systemd-units\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555581 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-slash\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555581 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-log-socket\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:45.555756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.555756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555666 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.555756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-run-ovn-kubernetes\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.555756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d126018-4b0c-4b87-889c-29c370b7977a-ovn-node-metrics-cert\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-os-release\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67fe2b29-f12f-4b3e-962b-54b660f54547-iptables-alerter-script\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67fe2b29-f12f-4b3e-962b-54b660f54547-host-slash\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-etc-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-cni-bin\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.555997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/809917ad-8294-4c00-826e-c6840d28d0ae-dbus\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.556103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-node-log\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-ovnkube-script-lib\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/809917ad-8294-4c00-826e-c6840d28d0ae-kubelet-config\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-system-cni-dir\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-ovn\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-kubelet\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-run-netns\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-env-overrides\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvn9q\" (UniqueName: \"kubernetes.io/projected/9d126018-4b0c-4b87-889c-29c370b7977a-kube-api-access-qvn9q\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qhh\" (UniqueName: \"kubernetes.io/projected/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-kube-api-access-95qhh\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-systemd\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.556696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-cni-netd\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.556965 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tgvxv\"" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.557138 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.557158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.557172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.557255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-prv2s\"" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.557308 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7p56d\"" Jul 06 20:34:45.557482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.557359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:34:45.559574 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.559551 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:34:45.560381 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.560357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:34:45.560531 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.560508 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ntgkv\"" Jul 06 20:34:45.560918 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.560897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:34:45.561038 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.561008 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:34:45.561171 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.561150 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lf2f6\"" Jul 06 20:34:45.563627 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.563589 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:34:45.586688 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.586660 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-msc9z" Jul 06 20:34:45.595425 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.595395 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-msc9z" Jul 06 20:34:45.644486 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.644457 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:34:45.657859 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be6238b4-58ba-440d-8e0b-2f8261713199-etc-tuned\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.657859 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-registration-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-hosts-file\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b6950a35-0ecf-4adf-b199-54041fbf2355-konnectivity-ca\") pod \"konnectivity-agent-94s42\" (UID: \"b6950a35-0ecf-4adf-b199-54041fbf2355\") " pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-kubelet\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.657999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-kubernetes\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-system-cni-dir\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-ovn\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-socket-dir-parent\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62174162-e378-40cf-b5fb-9fc1663d7448-multus-daemon-config\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysconfig\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62174162-e378-40cf-b5fb-9fc1663d7448-cni-binary-copy\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95qhh\" (UniqueName: \"kubernetes.io/projected/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-kube-api-access-95qhh\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zk4r\" (UniqueName: \"kubernetes.io/projected/be6238b4-58ba-440d-8e0b-2f8261713199-kube-api-access-2zk4r\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-cnibin\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-ovnkube-config\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9136d806-1d82-4d85-97a2-061188be0c8b-serviceca\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-log-socket\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9136d806-1d82-4d85-97a2-061188be0c8b-host\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-netns\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-lib-modules\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d126018-4b0c-4b87-889c-29c370b7977a-ovn-node-metrics-cert\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-sys-fs\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmln\" (UniqueName: \"kubernetes.io/projected/20d2b518-253a-43cf-8a02-0c0f180a56fa-kube-api-access-6kmln\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-os-release\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67fe2b29-f12f-4b3e-962b-54b660f54547-iptables-alerter-script\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67fe2b29-f12f-4b3e-962b-54b660f54547-host-slash\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-etc-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-cni-bin\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.658960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-ovnkube-script-lib\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.658989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/809917ad-8294-4c00-826e-c6840d28d0ae-dbus\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-node-log\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-socket-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-device-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfl9f\" (UniqueName: \"kubernetes.io/projected/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-kube-api-access-nfl9f\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-system-cni-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/809917ad-8294-4c00-826e-c6840d28d0ae-kubelet-config\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-hostroot\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysctl-d\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysctl-conf\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-sys\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-host\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-kubelet\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.659791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-run-netns\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-env-overrides\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvn9q\" (UniqueName: \"kubernetes.io/projected/9d126018-4b0c-4b87-889c-29c370b7977a-kube-api-access-qvn9q\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67fe2b29-f12f-4b3e-962b-54b660f54547-iptables-alerter-script\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-cni-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-cnibin\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-os-release\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-cni-bin\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-systemd\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-cni-netd\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c29l\" (UniqueName: \"kubernetes.io/projected/9136d806-1d82-4d85-97a2-061188be0c8b-kube-api-access-5c29l\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-tmp-dir\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-cni-multus\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-multus-certs\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9whs\" (UniqueName: \"kubernetes.io/projected/62174162-e378-40cf-b5fb-9fc1663d7448-kube-api-access-c9whs\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-systemd\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79cp\" (UniqueName: \"kubernetes.io/projected/67fe2b29-f12f-4b3e-962b-54b660f54547-kube-api-access-d79cp\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.660587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-var-lib-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b6950a35-0ecf-4adf-b199-54041fbf2355-agent-certs\") pod \"konnectivity-agent-94s42\" (UID: \"b6950a35-0ecf-4adf-b199-54041fbf2355\") " pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-var-lib-kubelet\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.659980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p79s4\" (UniqueName: \"kubernetes.io/projected/f612ed61-569d-4c7b-9b2b-c5b60441774a-kube-api-access-p79s4\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-systemd-units\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-slash\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-k8s-cni-cncf-io\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be6238b4-58ba-440d-8e0b-2f8261713199-tmp\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-run-ovn-kubernetes\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-conf-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-etc-kubernetes\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-modprobe-d\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-run\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.660429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-system-cni-dir\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.661038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.661371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.661138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-env-overrides\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.662147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.661448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-systemd\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.662147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.661503 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-cni-netd\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.662147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.661590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.662147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.661968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-run-ovn\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.662147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67fe2b29-f12f-4b3e-962b-54b660f54547-host-slash\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.662147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-etc-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.662423 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-cni-bin\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.662481 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-var-lib-openvswitch\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-systemd-units\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-ovnkube-script-lib\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-slash\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.662878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-run-ovn-kubernetes\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.662979 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/809917ad-8294-4c00-826e-c6840d28d0ae-dbus\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.663050 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:34:46.163017966 +0000 UTC m=+2.987322217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-node-log\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-kubelet\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/809917ad-8294-4c00-826e-c6840d28d0ae-kubelet-config\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:45.663222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-host-run-netns\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-cnibin\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.663755 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d126018-4b0c-4b87-889c-29c370b7977a-log-socket\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-os-release\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.663829 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:46.16380295 +0000 UTC m=+2.988107196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d126018-4b0c-4b87-889c-29c370b7977a-ovnkube-config\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.663917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f612ed61-569d-4c7b-9b2b-c5b60441774a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.664111 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:34:45.664871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.664148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f612ed61-569d-4c7b-9b2b-c5b60441774a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.668761 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.668735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d126018-4b0c-4b87-889c-29c370b7977a-ovn-node-metrics-cert\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.674842 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.674820 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:45.674958 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.674850 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:45.674958 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.674864 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:45.674958 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:45.674931 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:46.174913162 +0000 UTC m=+2.999217412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:45.684016 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.683965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p79s4\" (UniqueName: \"kubernetes.io/projected/f612ed61-569d-4c7b-9b2b-c5b60441774a-kube-api-access-p79s4\") pod \"multus-additional-cni-plugins-zpvlw\" (UID: \"f612ed61-569d-4c7b-9b2b-c5b60441774a\") " pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.684448 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.684425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qhh\" (UniqueName: \"kubernetes.io/projected/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-kube-api-access-95qhh\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:45.686949 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.686926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79cp\" (UniqueName: \"kubernetes.io/projected/67fe2b29-f12f-4b3e-962b-54b660f54547-kube-api-access-d79cp\") pod \"iptables-alerter-z79rj\" (UID: \"67fe2b29-f12f-4b3e-962b-54b660f54547\") " pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.687057 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.687018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvn9q\" (UniqueName: \"kubernetes.io/projected/9d126018-4b0c-4b87-889c-29c370b7977a-kube-api-access-qvn9q\") pod \"ovnkube-node-44lv8\" (UID: \"9d126018-4b0c-4b87-889c-29c370b7977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-socket-dir-parent\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62174162-e378-40cf-b5fb-9fc1663d7448-multus-daemon-config\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysconfig\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62174162-e378-40cf-b5fb-9fc1663d7448-cni-binary-copy\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zk4r\" (UniqueName: \"kubernetes.io/projected/be6238b4-58ba-440d-8e0b-2f8261713199-kube-api-access-2zk4r\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9136d806-1d82-4d85-97a2-061188be0c8b-serviceca\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9136d806-1d82-4d85-97a2-061188be0c8b-host\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-netns\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-lib-modules\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-sys-fs\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmln\" (UniqueName: \"kubernetes.io/projected/20d2b518-253a-43cf-8a02-0c0f180a56fa-kube-api-access-6kmln\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-socket-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-device-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl9f\" (UniqueName: \"kubernetes.io/projected/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-kube-api-access-nfl9f\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-system-cni-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.763337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-hostroot\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysctl-d\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysctl-conf\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-sys\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-host\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-sys-fs\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-cni-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-cnibin\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-os-release\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-socket-dir-parent\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-cni-bin\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c29l\" (UniqueName: \"kubernetes.io/projected/9136d806-1d82-4d85-97a2-061188be0c8b-kube-api-access-5c29l\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-tmp-dir\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-cni-multus\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-multus-certs\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9whs\" (UniqueName: \"kubernetes.io/projected/62174162-e378-40cf-b5fb-9fc1663d7448-kube-api-access-c9whs\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-systemd\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.764556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b6950a35-0ecf-4adf-b199-54041fbf2355-agent-certs\") pod \"konnectivity-agent-94s42\" (UID: \"b6950a35-0ecf-4adf-b199-54041fbf2355\") " pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.761971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-var-lib-kubelet\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-k8s-cni-cncf-io\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be6238b4-58ba-440d-8e0b-2f8261713199-tmp\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-conf-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-socket-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-device-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-system-cni-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-etc-kubernetes\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762251 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-etc-kubernetes\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-modprobe-d\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-run\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62174162-e378-40cf-b5fb-9fc1663d7448-multus-daemon-config\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-modprobe-d\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be6238b4-58ba-440d-8e0b-2f8261713199-etc-tuned\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-registration-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.765505 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysconfig\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-hosts-file\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b6950a35-0ecf-4adf-b199-54041fbf2355-konnectivity-ca\") pod \"konnectivity-agent-94s42\" (UID: \"b6950a35-0ecf-4adf-b199-54041fbf2355\") " pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-kubelet\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-kubernetes\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-kubernetes\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-multus-certs\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-hostroot\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762866 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-systemd\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762877 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysctl-d\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762866 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62174162-e378-40cf-b5fb-9fc1663d7448-cni-binary-copy\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9136d806-1d82-4d85-97a2-061188be0c8b-host\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-host\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.762985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-k8s-cni-cncf-io\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-etc-sysctl-conf\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-var-lib-kubelet\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-sys\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-run-netns\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.766405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-cni-bin\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-cni-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-lib-modules\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-os-release\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-cnibin\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20d2b518-253a-43cf-8a02-0c0f180a56fa-registration-dir\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-multus-conf-dir\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be6238b4-58ba-440d-8e0b-2f8261713199-run\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-cni-multus\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-tmp-dir\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-hosts-file\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.763621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62174162-e378-40cf-b5fb-9fc1663d7448-host-var-lib-kubelet\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.764142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9136d806-1d82-4d85-97a2-061188be0c8b-serviceca\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.764264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b6950a35-0ecf-4adf-b199-54041fbf2355-konnectivity-ca\") pod \"konnectivity-agent-94s42\" (UID: \"b6950a35-0ecf-4adf-b199-54041fbf2355\") " pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.767284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.766028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be6238b4-58ba-440d-8e0b-2f8261713199-tmp\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.767984 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.767924 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b6950a35-0ecf-4adf-b199-54041fbf2355-agent-certs\") pod \"konnectivity-agent-94s42\" (UID: \"b6950a35-0ecf-4adf-b199-54041fbf2355\") " pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.769660 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.769613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be6238b4-58ba-440d-8e0b-2f8261713199-etc-tuned\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.773898 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.773848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9whs\" (UniqueName: \"kubernetes.io/projected/62174162-e378-40cf-b5fb-9fc1663d7448-kube-api-access-c9whs\") pod \"multus-wwtt5\" (UID: \"62174162-e378-40cf-b5fb-9fc1663d7448\") " pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.775905 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.775825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfl9f\" (UniqueName: \"kubernetes.io/projected/ee292b2f-f27c-4bfa-bdab-cabf5ddbef81-kube-api-access-nfl9f\") pod \"node-resolver-w7j9k\" (UID: \"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81\") " pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.777626 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.777586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zk4r\" (UniqueName: \"kubernetes.io/projected/be6238b4-58ba-440d-8e0b-2f8261713199-kube-api-access-2zk4r\") pod \"tuned-n9r6x\" (UID: \"be6238b4-58ba-440d-8e0b-2f8261713199\") " pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.778498 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.778480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmln\" (UniqueName: \"kubernetes.io/projected/20d2b518-253a-43cf-8a02-0c0f180a56fa-kube-api-access-6kmln\") pod \"aws-ebs-csi-driver-node-2rtgf\" (UID: \"20d2b518-253a-43cf-8a02-0c0f180a56fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.778989 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.778944 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c29l\" (UniqueName: \"kubernetes.io/projected/9136d806-1d82-4d85-97a2-061188be0c8b-kube-api-access-5c29l\") pod \"node-ca-qt77r\" (UID: \"9136d806-1d82-4d85-97a2-061188be0c8b\") " pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.851386 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.851350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" Jul 06 20:34:45.862376 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.862342 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z79rj" Jul 06 20:34:45.872677 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.872639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:34:45.878864 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.878843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" Jul 06 20:34:45.886643 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.886619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" Jul 06 20:34:45.894555 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.894519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qt77r" Jul 06 20:34:45.904389 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.904343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w7j9k" Jul 06 20:34:45.912597 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.912563 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-94s42" Jul 06 20:34:45.918772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.918743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwtt5" Jul 06 20:34:45.975624 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:45.975578 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:46.166043 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.165947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:46.166043 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.166025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:46.166287 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.166132 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:46.166287 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.166134 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:46.166287 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.166223 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:34:47.166202546 +0000 UTC m=+3.990506793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:46.166287 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.166246 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:47.166235277 +0000 UTC m=+3.990539517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:46.267304 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.267259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:46.267588 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.267431 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:46.267588 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.267457 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:46.267588 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.267470 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:46.267588 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.267539 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:47.267518727 +0000 UTC m=+4.091822974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:46.598428 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.598390 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:29:46 +0000 UTC" deadline="2028-02-06 11:24:36.621701856 +0000 UTC" Jul 06 20:34:46.598428 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.598423 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13910h49m50.02328247s" Jul 06 20:34:46.647092 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.647046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:46.647264 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:46.647105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:46.647264 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.647195 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:46.647378 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:46.647339 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:46.942989 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:46.942958 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d2b518_253a_43cf_8a02_0c0f180a56fa.slice/crio-2a3e7f06c924a50fe72328cfea40c9fed42334cc2f9d12de196f3ab405016efc WatchSource:0}: Error finding container 2a3e7f06c924a50fe72328cfea40c9fed42334cc2f9d12de196f3ab405016efc: Status 404 returned error can't find the container with id 2a3e7f06c924a50fe72328cfea40c9fed42334cc2f9d12de196f3ab405016efc Jul 06 20:34:46.946094 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:46.946064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6238b4_58ba_440d_8e0b_2f8261713199.slice/crio-36dc2f50c258101b88c195ebc930c43783b00db2dc746bbbec9df7cee0aae664 WatchSource:0}: Error finding container 36dc2f50c258101b88c195ebc930c43783b00db2dc746bbbec9df7cee0aae664: Status 404 returned error can't find the container with id 36dc2f50c258101b88c195ebc930c43783b00db2dc746bbbec9df7cee0aae664 Jul 06 20:34:46.948496 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:46.948474 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9136d806_1d82_4d85_97a2_061188be0c8b.slice/crio-db7d043f2e2ded0044dd3305523307d1ec5dddce96de53854d0bf77b8bf498c2 WatchSource:0}: Error finding container db7d043f2e2ded0044dd3305523307d1ec5dddce96de53854d0bf77b8bf498c2: Status 404 returned error can't find the container with id db7d043f2e2ded0044dd3305523307d1ec5dddce96de53854d0bf77b8bf498c2 Jul 06 20:34:46.950406 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:46.950378 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fe2b29_f12f_4b3e_962b_54b660f54547.slice/crio-cfc84db08055e163e4a52abfa4c6cfdb9eb7e5eb40ca9f58b36f6c0be30817aa WatchSource:0}: Error finding container cfc84db08055e163e4a52abfa4c6cfdb9eb7e5eb40ca9f58b36f6c0be30817aa: Status 404 returned error can't find the container with id cfc84db08055e163e4a52abfa4c6cfdb9eb7e5eb40ca9f58b36f6c0be30817aa Jul 06 20:34:46.951788 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:34:46.951753 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf612ed61_569d_4c7b_9b2b_c5b60441774a.slice/crio-5ce70aeaecb185dd416a56fb5944f70ae5a6054fe728054426fbd448a84d8f81 WatchSource:0}: Error finding container 5ce70aeaecb185dd416a56fb5944f70ae5a6054fe728054426fbd448a84d8f81: Status 404 returned error can't find the container with id 5ce70aeaecb185dd416a56fb5944f70ae5a6054fe728054426fbd448a84d8f81 Jul 06 20:34:47.175901 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.175701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:47.175975 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.175931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:47.176011 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.175887 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:47.176042 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.176033 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:47.176077 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.176058 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:49.176035479 +0000 UTC m=+6.000339712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:47.176116 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.176077 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:34:49.176065422 +0000 UTC m=+6.000369667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:47.277274 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.277244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:47.277460 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.277439 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:47.277501 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.277467 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:47.277501 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.277478 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:47.277610 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.277532 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:49.277518446 +0000 UTC m=+6.101822678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:47.598752 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.598679 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:29:46 +0000 UTC" deadline="2028-04-04 12:39:47.955873208 +0000 UTC" Jul 06 20:34:47.598752 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.598749 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15304h5m0.357128752s" Jul 06 20:34:47.647251 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.647216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:47.647448 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:47.647374 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:47.664623 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.664091 2578 generic.go:356] "Generic (PLEG): container finished" podID="2b574a658b6026d17b7636034f150900" containerID="bfb35a43e1c7ba8c2818652d876325434e5c4ea0d1a83b8d81e754e6b44cbfc6" exitCode=0 Jul 06 20:34:47.664623 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.664187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" event={"ID":"2b574a658b6026d17b7636034f150900","Type":"ContainerDied","Data":"bfb35a43e1c7ba8c2818652d876325434e5c4ea0d1a83b8d81e754e6b44cbfc6"} Jul 06 20:34:47.671768 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.671734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-94s42" event={"ID":"b6950a35-0ecf-4adf-b199-54041fbf2355","Type":"ContainerStarted","Data":"5d7755bb2ef7e588720a13bccaef3181974c49df4a8585e968b09a4ea427263b"} Jul 06 20:34:47.675231 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.675162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwtt5" event={"ID":"62174162-e378-40cf-b5fb-9fc1663d7448","Type":"ContainerStarted","Data":"a793e0c51d69a85af55c86eed383453030cd87a1eee0cfe3274d782360ccd0f3"} Jul 06 20:34:47.678127 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.678040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w7j9k" event={"ID":"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81","Type":"ContainerStarted","Data":"96c173a274983057bc181919dba8a0d602d3c0b3945907d46a45c537921ce655"} Jul 06 20:34:47.684521 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.683892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z79rj" event={"ID":"67fe2b29-f12f-4b3e-962b-54b660f54547","Type":"ContainerStarted","Data":"cfc84db08055e163e4a52abfa4c6cfdb9eb7e5eb40ca9f58b36f6c0be30817aa"} Jul 06 20:34:47.692464 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.692384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qt77r" event={"ID":"9136d806-1d82-4d85-97a2-061188be0c8b","Type":"ContainerStarted","Data":"db7d043f2e2ded0044dd3305523307d1ec5dddce96de53854d0bf77b8bf498c2"} Jul 06 20:34:47.697334 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.697260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" event={"ID":"be6238b4-58ba-440d-8e0b-2f8261713199","Type":"ContainerStarted","Data":"36dc2f50c258101b88c195ebc930c43783b00db2dc746bbbec9df7cee0aae664"} Jul 06 20:34:47.706699 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.705726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" event={"ID":"20d2b518-253a-43cf-8a02-0c0f180a56fa","Type":"ContainerStarted","Data":"2a3e7f06c924a50fe72328cfea40c9fed42334cc2f9d12de196f3ab405016efc"} Jul 06 20:34:47.722028 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.721991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" event={"ID":"9f4db311b901a006fd4141a884f57806","Type":"ContainerStarted","Data":"735b0bbb2324be72fc9b67c1ba2702bdbe92116f0950fe710be5fba0c4cdc020"} Jul 06 20:34:47.734085 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.734047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"c01bd41f79f0aed22fc3010fba490ec75b6ba043a207bcd1c7624be8881560cb"} Jul 06 20:34:47.762156 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:47.762113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerStarted","Data":"5ce70aeaecb185dd416a56fb5944f70ae5a6054fe728054426fbd448a84d8f81"} Jul 06 20:34:48.647320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:48.646421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:48.647320 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:48.646607 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:48.647320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:48.647041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:48.647320 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:48.647135 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:48.796260 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:48.796192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" event={"ID":"2b574a658b6026d17b7636034f150900","Type":"ContainerStarted","Data":"4470b7f2bde758e69689f6c48a891267c34e35d5f96c8583ed69c4ad1757b808"} Jul 06 20:34:48.817193 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:48.817123 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-92.ec2.internal" podStartSLOduration=3.817100795 podStartE2EDuration="3.817100795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:34:47.749383874 +0000 UTC m=+4.573688131" watchObservedRunningTime="2026-07-06 20:34:48.817100795 +0000 UTC m=+5.641405052" Jul 06 20:34:48.817396 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:48.817364 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-92.ec2.internal" podStartSLOduration=3.817351597 podStartE2EDuration="3.817351597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:34:48.816232278 +0000 UTC m=+5.640536534" watchObservedRunningTime="2026-07-06 20:34:48.817351597 +0000 UTC m=+5.641655853" Jul 06 20:34:49.195113 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:49.195071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:49.195364 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:49.195177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:49.195364 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.195303 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:49.195499 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.195368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:53.195349527 +0000 UTC m=+10.019653777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:49.195736 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.195714 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:49.195811 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.195775 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:34:53.195759415 +0000 UTC m=+10.020063651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:49.297380 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:49.296737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:49.297380 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.297007 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:49.297380 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.297030 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:49.297380 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.297044 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:49.297380 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.297104 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:53.297085325 +0000 UTC m=+10.121389557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:49.646862 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:49.646828 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:49.647051 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:49.646980 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:50.646429 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:50.646384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:50.646937 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:50.646388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:50.646937 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:50.646535 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:50.646937 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:50.646621 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:51.648539 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:51.648483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:51.649033 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:51.648699 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:52.646904 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:52.646815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:52.647078 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:52.646970 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:52.647378 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:52.647358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:52.647491 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:52.647471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:53.231849 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:53.231191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:53.231849 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:53.231248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:53.231849 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.231402 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:53.231849 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.231407 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:53.231849 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.231476 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:35:01.231456453 +0000 UTC m=+18.055760708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:53.231849 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.231499 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:01.231487112 +0000 UTC m=+18.055791345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:53.332122 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:53.332078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:53.332320 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.332287 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:53.332320 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.332310 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:53.332417 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.332323 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:53.332417 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.332387 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:01.332367479 +0000 UTC m=+18.156671727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:53.648067 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:53.648031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:53.648284 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:53.648137 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:54.646573 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:54.646534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:54.646573 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:54.646551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:54.647060 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:54.646655 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:54.647116 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:54.647053 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:55.650043 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:55.649959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:55.650507 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:55.650134 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:56.646608 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:56.646578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:56.646608 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:56.646601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:56.646815 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:56.646681 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:56.646859 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:56.646820 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:57.646899 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:57.646861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:57.647302 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:57.646972 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:34:58.646935 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:58.646847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:34:58.647421 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:58.646855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:34:58.647421 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:58.646982 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:34:58.647421 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:58.647071 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:34:59.647375 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:34:59.647342 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:34:59.647863 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:34:59.647468 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:00.646828 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:00.646786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:00.647029 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:00.646933 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:00.647029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:00.646985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:00.647130 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:00.647106 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:01.294168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:01.294125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:01.294697 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:01.294198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:01.294697 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.294287 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:01.294697 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.294313 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:01.294697 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.294367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:17.294346117 +0000 UTC m=+34.118650353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:01.294697 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.294390 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:35:17.294378881 +0000 UTC m=+34.118683117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:01.394916 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:01.394879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:01.395094 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.395058 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:01.395094 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.395084 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:01.395094 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.395096 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:01.395210 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.395151 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:17.395137994 +0000 UTC m=+34.219442236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:01.647131 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:01.647044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:01.647289 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:01.647189 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:02.646672 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:02.646633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:02.647123 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:02.646649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:02.647123 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:02.646779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:02.647123 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:02.646865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:03.647236 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:03.647201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:03.647719 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:03.647299 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:04.646727 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:04.646687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:04.646727 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:04.646725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:04.646950 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:04.646844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:04.647011 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:04.646941 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:05.646627 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:05.646587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:05.647007 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:05.646722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:06.647541 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.647214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:06.648089 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.647254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:06.648089 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:06.647643 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:06.648089 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:06.647730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:06.836587 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.836550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-94s42" event={"ID":"b6950a35-0ecf-4adf-b199-54041fbf2355","Type":"ContainerStarted","Data":"10a46a3d7a262605d5d75d86d7d80b3ad50b484362bbf678510c4fe91febca75"} Jul 06 20:35:06.838029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.838004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwtt5" event={"ID":"62174162-e378-40cf-b5fb-9fc1663d7448","Type":"ContainerStarted","Data":"f0f4da9c5fce1622ff6e3c51972f03272d1378994f4577eae5d6420c6a619374"} Jul 06 20:35:06.839327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.839301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w7j9k" event={"ID":"ee292b2f-f27c-4bfa-bdab-cabf5ddbef81","Type":"ContainerStarted","Data":"ff41a27110c5b367e22f9ee720ac8b306158ef8e1f0f47698d5533d161b20e1c"} Jul 06 20:35:06.840661 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.840638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qt77r" event={"ID":"9136d806-1d82-4d85-97a2-061188be0c8b","Type":"ContainerStarted","Data":"a51ea177468fd1764f92ea23da469aecd8462eaffbdccf08b9f97aca93560fc0"} Jul 06 20:35:06.842266 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.842241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" event={"ID":"be6238b4-58ba-440d-8e0b-2f8261713199","Type":"ContainerStarted","Data":"7c8023e0cd0a8fba2bc8cd5ea54805b5550c02ddf45b6c12566fe4f15535332a"} Jul 06 20:35:06.843983 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.843958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" event={"ID":"20d2b518-253a-43cf-8a02-0c0f180a56fa","Type":"ContainerStarted","Data":"0ea753504fe10982ed5831def08a490169e52825a93d6dc244d354455706a1eb"} Jul 06 20:35:06.846897 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.846877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"d1d5e757f0f71405964f1d5cdd7fdf8c19563357f35043096e7fdce7095b8180"} Jul 06 20:35:06.846978 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.846941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"f5506567b6f4c4c245e452cdd3c52b42e4849e04c3bd2669648c4eacddc20cbe"} Jul 06 20:35:06.847023 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.846987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"f5b41836611052adbe56368141e1a3dbb205215acc6f006f00b1a621d72a74b7"} Jul 06 20:35:06.847023 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.847019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"812559804cb87e25b94cf5762ef2a4d7b89f617d4fb38535d096fa5881fb5b2b"} Jul 06 20:35:06.847093 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.847049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"7acecacf38e6c5a279a272e2820f4b7e4319ebf28434ab56538ea9b57f14f12a"} Jul 06 20:35:06.848238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.848219 2578 generic.go:356] "Generic (PLEG): container finished" podID="f612ed61-569d-4c7b-9b2b-c5b60441774a" containerID="b9da8e1defbea4b8341a4820be2b26fbd3bf550806607f5dad75de8eea41551b" exitCode=0 Jul 06 20:35:06.848301 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.848248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerDied","Data":"b9da8e1defbea4b8341a4820be2b26fbd3bf550806607f5dad75de8eea41551b"} Jul 06 20:35:06.856366 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.856330 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-94s42" podStartSLOduration=7.767015606 podStartE2EDuration="22.856319169s" totalImagesPullingTime="15.089303563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:06.856105667 +0000 UTC m=+23.680409919" watchObservedRunningTime="2026-07-06 20:35:06.856319169 +0000 UTC m=+23.680623420" Jul 06 20:35:06.874627 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.874568 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qt77r" podStartSLOduration=3.706692324 podStartE2EDuration="22.874546424s" totalImagesPullingTime="19.1678541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:06.874074271 +0000 UTC m=+23.698378525" watchObservedRunningTime="2026-07-06 20:35:06.874546424 +0000 UTC m=+23.698850679" Jul 06 20:35:06.929308 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.929216 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w7j9k" podStartSLOduration=3.770879492 podStartE2EDuration="22.929198317s" totalImagesPullingTime="19.158318825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:06.901931678 +0000 UTC m=+23.726235929" watchObservedRunningTime="2026-07-06 20:35:06.929198317 +0000 UTC m=+23.753502646" Jul 06 20:35:06.948888 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.948840 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n9r6x" podStartSLOduration=3.758719418 podStartE2EDuration="22.948823394s" totalImagesPullingTime="19.190103976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:06.948744226 +0000 UTC m=+23.773048477" watchObservedRunningTime="2026-07-06 20:35:06.948823394 +0000 UTC m=+23.773127646" Jul 06 20:35:06.970092 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:06.970043 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wwtt5" podStartSLOduration=3.741106602 podStartE2EDuration="22.970028098s" totalImagesPullingTime="19.228921496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:06.969471841 +0000 UTC m=+23.793776094" watchObservedRunningTime="2026-07-06 20:35:06.970028098 +0000 UTC m=+23.794332350" Jul 06 20:35:07.646980 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.646953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:07.647181 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:07.647069 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:07.657166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.657137 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-94s42" Jul 06 20:35:07.657679 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.657663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-94s42" Jul 06 20:35:07.853306 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.853273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"3ad2bdfc844695fbcde5ad80b4281897dfd5cde11b119f95d028c4b476cf080c"} Jul 06 20:35:07.854723 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.854698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z79rj" event={"ID":"67fe2b29-f12f-4b3e-962b-54b660f54547","Type":"ContainerStarted","Data":"16424342f0fab95e89594f58e8867d558f564f59c3138734ff547adc7a8b975e"} Jul 06 20:35:07.855327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.855307 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-94s42" Jul 06 20:35:07.855439 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.855366 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-94s42" Jul 06 20:35:07.875223 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:07.875184 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z79rj" podStartSLOduration=4.6940136599999995 podStartE2EDuration="23.875170061s" totalImagesPullingTime="19.181156401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:07.874715246 +0000 UTC m=+24.699019499" watchObservedRunningTime="2026-07-06 20:35:07.875170061 +0000 UTC m=+24.699474331" Jul 06 20:35:08.024155 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.024126 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:35:08.620712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.620611 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:35:08.024148767Z","UUID":"08856fb5-8d37-4780-b601-5c16abffd37a","Handler":null,"Name":"","Endpoint":""} Jul 06 20:35:08.622537 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.622494 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:35:08.622665 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.622565 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:35:08.646364 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.646329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:08.646364 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.646345 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:08.646654 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:08.646461 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:08.646654 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:08.646560 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:08.858629 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:08.858593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" event={"ID":"20d2b518-253a-43cf-8a02-0c0f180a56fa","Type":"ContainerStarted","Data":"ce328f1aaf5e05efbb49c159f3a74d581001f03ff31cfd47d0a5555157df0229"} Jul 06 20:35:09.647069 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:09.646990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:09.647212 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:09.647091 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:09.861875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:09.861835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" event={"ID":"20d2b518-253a-43cf-8a02-0c0f180a56fa","Type":"ContainerStarted","Data":"ac2e455c93fee2aa5f33da7511c305ddd87c2e8bf833ace7f3f6ce34da7960a7"} Jul 06 20:35:09.865063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:09.865042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"866bc4a4babe907f92a6995069342d1db458e67295f48fa419b49ebd0c512bed"} Jul 06 20:35:09.894649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:09.894600 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rtgf" podStartSLOduration=3.872549578 podStartE2EDuration="25.894582357s" totalImagesPullingTime="22.022032779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:09.894244436 +0000 UTC m=+26.718548687" watchObservedRunningTime="2026-07-06 20:35:09.894582357 +0000 UTC m=+26.718886619" Jul 06 20:35:10.646825 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:10.646556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:10.647003 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:10.646599 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:10.647003 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:10.646946 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:10.647003 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:10.646983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:11.646870 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:11.646832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:11.647589 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:11.646939 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:11.874679 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:11.874632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" event={"ID":"9d126018-4b0c-4b87-889c-29c370b7977a","Type":"ContainerStarted","Data":"5c1bef9ea3513a669e69d8e021fa30f5915c4a4c043fa3de8da7c58434f394d7"} Jul 06 20:35:11.874977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:11.874940 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:35:11.875117 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:11.875027 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:35:11.893499 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:11.893463 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:35:11.908081 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:11.907962 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" podStartSLOduration=8.658673262 podStartE2EDuration="27.907939744s" totalImagesPullingTime="19.249266482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:11.905940059 +0000 UTC m=+28.730244310" watchObservedRunningTime="2026-07-06 20:35:11.907939744 +0000 UTC m=+28.732243997" Jul 06 20:35:12.647553 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:12.647268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:12.647957 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:12.647268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:12.647957 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:12.647665 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:12.647957 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:12.647749 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:12.877465 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:12.877432 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:35:12.894815 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:12.894779 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:35:13.651117 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.651076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:13.651717 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:13.651206 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:13.888444 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.888413 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvbsl"] Jul 06 20:35:13.888638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.888575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:13.888709 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:13.888678 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:13.891437 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.891415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6vbfp"] Jul 06 20:35:13.891574 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.891491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:13.891653 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:13.891590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:13.892722 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.892703 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhwm8"] Jul 06 20:35:13.892829 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:13.892802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:13.892894 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:13.892882 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:14.884143 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:14.884106 2578 generic.go:356] "Generic (PLEG): container finished" podID="f612ed61-569d-4c7b-9b2b-c5b60441774a" containerID="388758099be2173577aa257d2b686f1148e38ffa6d371484abb468db5d4d79a9" exitCode=0 Jul 06 20:35:14.884535 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:14.884194 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerDied","Data":"388758099be2173577aa257d2b686f1148e38ffa6d371484abb468db5d4d79a9"} Jul 06 20:35:15.646927 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:15.646790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:15.646927 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:15.646818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:15.646927 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:15.646803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:15.646927 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:15.646933 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:15.646927 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:15.647003 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:15.646927 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:15.647074 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:16.890421 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:16.890385 2578 generic.go:356] "Generic (PLEG): container finished" podID="f612ed61-569d-4c7b-9b2b-c5b60441774a" containerID="6d4bd5aa86967d9d055bafbd1f60d5aeba0db9bdf006ec4a598b1e583cfa6aaf" exitCode=0 Jul 06 20:35:16.890854 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:16.890437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerDied","Data":"6d4bd5aa86967d9d055bafbd1f60d5aeba0db9bdf006ec4a598b1e583cfa6aaf"} Jul 06 20:35:17.316496 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.316457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:17.316696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.316535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:17.316696 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.316639 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:17.316696 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.316688 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:17.316845 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.316713 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:49.316692565 +0000 UTC m=+66.140996815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:17.316845 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.316742 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret podName:809917ad-8294-4c00-826e-c6840d28d0ae nodeName:}" failed. No retries permitted until 2026-07-06 20:35:49.316725825 +0000 UTC m=+66.141030067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret") pod "global-pull-secret-syncer-vvbsl" (UID: "809917ad-8294-4c00-826e-c6840d28d0ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:17.417353 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.417312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:17.417509 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.417483 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:17.417509 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.417499 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:17.417509 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.417508 2578 projected.go:196] Error preparing data for projected volume kube-api-access-q9v67 for pod openshift-network-diagnostics/network-check-target-6vbfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:17.417650 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.417569 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67 podName:42928fd1-1a1a-4fad-916e-93bbaaa0f639 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:49.417555124 +0000 UTC m=+66.241859354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9v67" (UniqueName: "kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67") pod "network-check-target-6vbfp" (UID: "42928fd1-1a1a-4fad-916e-93bbaaa0f639") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:17.647418 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.647392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:17.647556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.647396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:17.647556 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.647537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:17.647556 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.647545 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvbsl" podUID="809917ad-8294-4c00-826e-c6840d28d0ae" Jul 06 20:35:17.647682 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.647613 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6vbfp" podUID="42928fd1-1a1a-4fad-916e-93bbaaa0f639" Jul 06 20:35:17.647715 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:17.647694 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhwm8" podUID="02c1e87e-16f0-47a9-8c84-3ef8a5e889c0" Jul 06 20:35:17.895080 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.894983 2578 generic.go:356] "Generic (PLEG): container finished" podID="f612ed61-569d-4c7b-9b2b-c5b60441774a" containerID="bd371cbbd0ab0d573720d8cc28807a397aadbda5d88d9501cfb34fab51bbc96f" exitCode=0 Jul 06 20:35:17.895080 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:17.895041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerDied","Data":"bd371cbbd0ab0d573720d8cc28807a397aadbda5d88d9501cfb34fab51bbc96f"} Jul 06 20:35:19.009551 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.008705 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-92.ec2.internal" event="NodeReady" Jul 06 20:35:19.009551 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.008963 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:35:19.055680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.055649 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-687ffffbb6-827b6"] Jul 06 20:35:19.058443 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.058428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.066140 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.066073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:35:19.066324 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.066310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:35:19.066416 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.066389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6p5d9\"" Jul 06 20:35:19.066492 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.066475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:35:19.074385 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.074364 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:35:19.074965 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.074915 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b4h79"] Jul 06 20:35:19.077866 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.077848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.080253 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.080232 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687ffffbb6-827b6"] Jul 06 20:35:19.080456 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.080441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ng9hs\"" Jul 06 20:35:19.080590 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.080575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:35:19.080720 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.080704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:35:19.081662 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.081641 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9sjhf"] Jul 06 20:35:19.085000 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.084981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.087652 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.087634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fq9ht\"" Jul 06 20:35:19.088646 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.088631 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:35:19.088985 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.088962 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:35:19.089057 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.089002 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:35:19.095181 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.095163 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4h79"] Jul 06 20:35:19.100023 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.100003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9sjhf"] Jul 06 20:35:19.129048 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-ca-trust-extracted\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129048 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2flt\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-kube-api-access-t2flt\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-image-registry-private-configuration\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-installation-pull-secrets\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-bound-sa-token\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-certificates\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.129389 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.129258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-trusted-ca\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230203 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-trusted-ca\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230372 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27tmc\" (UniqueName: \"kubernetes.io/projected/59edef18-394d-4f0f-a538-916ec76d5482-kube-api-access-27tmc\") pod \"ingress-canary-9sjhf\" (UID: \"59edef18-394d-4f0f-a538-916ec76d5482\") " pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.230372 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-ca-trust-extracted\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230372 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2flt\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-kube-api-access-t2flt\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230372 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59edef18-394d-4f0f-a538-916ec76d5482-cert\") pod \"ingress-canary-9sjhf\" (UID: \"59edef18-394d-4f0f-a538-916ec76d5482\") " pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0d00a7-6446-4b57-a9b8-246bddc9000e-config-volume\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-image-registry-private-configuration\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-installation-pull-secrets\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-bound-sa-token\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0d00a7-6446-4b57-a9b8-246bddc9000e-tmp-dir\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-certificates\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.230644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvml\" (UniqueName: \"kubernetes.io/projected/dc0d00a7-6446-4b57-a9b8-246bddc9000e-kube-api-access-hvvml\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.231040 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.230769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-ca-trust-extracted\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.231233 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.231208 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:19.231233 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.231231 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:19.231398 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.231283 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:19.731265534 +0000 UTC m=+36.555569780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:19.231398 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.231371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-trusted-ca\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.231514 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.231416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-certificates\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.235233 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.235213 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-installation-pull-secrets\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.235311 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.235227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-image-registry-private-configuration\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.246741 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.246682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2flt\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-kube-api-access-t2flt\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.246891 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.246858 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-bound-sa-token\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.330982 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.330939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.330982 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.330982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0d00a7-6446-4b57-a9b8-246bddc9000e-tmp-dir\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.331238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.331013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvml\" (UniqueName: \"kubernetes.io/projected/dc0d00a7-6446-4b57-a9b8-246bddc9000e-kube-api-access-hvvml\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.331238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.331041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27tmc\" (UniqueName: \"kubernetes.io/projected/59edef18-394d-4f0f-a538-916ec76d5482-kube-api-access-27tmc\") pod \"ingress-canary-9sjhf\" (UID: \"59edef18-394d-4f0f-a538-916ec76d5482\") " pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.331238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.331078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59edef18-394d-4f0f-a538-916ec76d5482-cert\") pod \"ingress-canary-9sjhf\" (UID: \"59edef18-394d-4f0f-a538-916ec76d5482\") " pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.331238 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.331081 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:19.331238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.331094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0d00a7-6446-4b57-a9b8-246bddc9000e-config-volume\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.331238 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.331152 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:35:19.831131699 +0000 UTC m=+36.655435946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:19.331471 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.331453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0d00a7-6446-4b57-a9b8-246bddc9000e-tmp-dir\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.331731 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.331711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc0d00a7-6446-4b57-a9b8-246bddc9000e-config-volume\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.333720 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.333702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59edef18-394d-4f0f-a538-916ec76d5482-cert\") pod \"ingress-canary-9sjhf\" (UID: \"59edef18-394d-4f0f-a538-916ec76d5482\") " pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.345629 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.345607 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27tmc\" (UniqueName: \"kubernetes.io/projected/59edef18-394d-4f0f-a538-916ec76d5482-kube-api-access-27tmc\") pod \"ingress-canary-9sjhf\" (UID: \"59edef18-394d-4f0f-a538-916ec76d5482\") " pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.345933 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.345918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvml\" (UniqueName: \"kubernetes.io/projected/dc0d00a7-6446-4b57-a9b8-246bddc9000e-kube-api-access-hvvml\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.386057 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.386028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:19.393976 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.393948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9sjhf" Jul 06 20:35:19.516352 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.516326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:19.556749 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.556427 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9sjhf"] Jul 06 20:35:19.561604 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:35:19.561571 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59edef18_394d_4f0f_a538_916ec76d5482.slice/crio-c68e981865063ca2190bf259873beb55046cae6a524ebdc9c2dc30ad493f49c5 WatchSource:0}: Error finding container c68e981865063ca2190bf259873beb55046cae6a524ebdc9c2dc30ad493f49c5: Status 404 returned error can't find the container with id c68e981865063ca2190bf259873beb55046cae6a524ebdc9c2dc30ad493f49c5 Jul 06 20:35:19.646900 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.646862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:19.646900 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.646862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:19.647123 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.646909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:19.652957 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.652932 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:35:19.653096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.653036 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pf4w\"" Jul 06 20:35:19.654401 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.654382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:35:19.654699 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.654683 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:35:19.654760 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.654688 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:35:19.654874 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.654855 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gll5g\"" Jul 06 20:35:19.734667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.734631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:19.734802 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.734783 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:19.734802 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.734800 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:19.734885 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.734857 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:20.734840336 +0000 UTC m=+37.559144583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:19.835845 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.835740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:19.835986 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.835890 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:19.835986 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:19.835957 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:35:20.835941674 +0000 UTC m=+37.660245904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:19.901159 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:19.901126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9sjhf" event={"ID":"59edef18-394d-4f0f-a538-916ec76d5482","Type":"ContainerStarted","Data":"c68e981865063ca2190bf259873beb55046cae6a524ebdc9c2dc30ad493f49c5"} Jul 06 20:35:20.744182 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:20.744146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:20.745026 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:20.744314 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:20.745026 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:20.744334 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:20.745026 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:20.744409 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:22.744381035 +0000 UTC m=+39.568685279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:20.844865 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:20.844823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:20.845056 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:20.844991 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:20.845111 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:20.845074 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:35:22.845052171 +0000 UTC m=+39.669356488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:22.761451 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:22.761410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:22.761948 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:22.761612 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:22.761948 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:22.761635 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:22.761948 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:22.761701 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:26.761681729 +0000 UTC m=+43.585985980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:22.862461 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:22.862422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:22.862664 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:22.862587 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:22.862664 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:22.862661 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:35:26.862645565 +0000 UTC m=+43.686949809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:24.120076 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:24.120027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:24.217560 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:24.217533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:24.916183 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:24.916143 2578 generic.go:356] "Generic (PLEG): container finished" podID="f612ed61-569d-4c7b-9b2b-c5b60441774a" containerID="78cfc574e060597217ac229e2b0b90e1769c11e74bba7546b7daa26f293764ec" exitCode=0 Jul 06 20:35:24.916377 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:24.916222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerDied","Data":"78cfc574e060597217ac229e2b0b90e1769c11e74bba7546b7daa26f293764ec"} Jul 06 20:35:24.917747 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:24.917702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9sjhf" event={"ID":"59edef18-394d-4f0f-a538-916ec76d5482","Type":"ContainerStarted","Data":"906d2c926c5680ad5d4d3d65a397f0df618dbcc381ab3caea7aab9a454c68425"} Jul 06 20:35:25.001968 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:25.001920 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9sjhf" podStartSLOduration=1.470496044 podStartE2EDuration="6.001903379s" totalImagesPullingTime="4.531407335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:25.00139848 +0000 UTC m=+41.825702731" watchObservedRunningTime="2026-07-06 20:35:25.001903379 +0000 UTC m=+41.826207632" Jul 06 20:35:25.140952 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:25.140923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:25.224116 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:25.224036 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:25.924255 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:25.924220 2578 generic.go:356] "Generic (PLEG): container finished" podID="f612ed61-569d-4c7b-9b2b-c5b60441774a" containerID="168010bff04fab5bc4df3251561d7e418d0c89bc7439e1476b4f0e3abc1ddb80" exitCode=0 Jul 06 20:35:25.924411 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:25.924311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerDied","Data":"168010bff04fab5bc4df3251561d7e418d0c89bc7439e1476b4f0e3abc1ddb80"} Jul 06 20:35:26.791243 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:26.791203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:26.791735 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:26.791390 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:26.791735 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:26.791418 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:26.791735 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:26.791493 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:34.791469803 +0000 UTC m=+51.615774049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:26.892161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:26.892116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:26.892342 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:26.892263 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:26.892342 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:26.892328 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:35:34.892314155 +0000 UTC m=+51.716618389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:26.929669 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:26.929632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" event={"ID":"f612ed61-569d-4c7b-9b2b-c5b60441774a","Type":"ContainerStarted","Data":"b0caf0e6c623609e77985f0be7f2c3a808b7eeed6747e0cf143c654abcdf47ca"} Jul 06 20:35:26.970244 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:26.970188 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zpvlw" podStartSLOduration=8.963496339 podStartE2EDuration="42.970169581s" totalImagesPullingTime="34.006673242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:26.969916042 +0000 UTC m=+43.794220294" watchObservedRunningTime="2026-07-06 20:35:26.970169581 +0000 UTC m=+43.794473827" Jul 06 20:35:27.137405 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:27.137314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:27.232369 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:27.232331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:27.308350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:27.308317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:28.080112 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:28.080083 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:34.848158 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:34.848109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:34.848590 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:34.848283 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:34.848590 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:34.848304 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:34.848590 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:34.848361 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:50.848344613 +0000 UTC m=+67.672648844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:34.948660 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:34.948631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:34.948833 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:34.948799 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:34.948902 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:34.948883 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:35:50.948860275 +0000 UTC m=+67.773164518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:44.900374 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:44.900347 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44lv8" Jul 06 20:35:49.342302 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.342254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:49.342789 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.342352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:35:49.345490 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.345471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:35:49.345911 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.345894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:35:49.353123 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:49.353103 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:35:49.353198 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:49.353187 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs podName:02c1e87e-16f0-47a9-8c84-3ef8a5e889c0 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:53.353167281 +0000 UTC m=+130.177471511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs") pod "network-metrics-daemon-qhwm8" (UID: "02c1e87e-16f0-47a9-8c84-3ef8a5e889c0") : secret "metrics-daemon-secret" not found Jul 06 20:35:49.356296 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.356273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809917ad-8294-4c00-826e-c6840d28d0ae-original-pull-secret\") pod \"global-pull-secret-syncer-vvbsl\" (UID: \"809917ad-8294-4c00-826e-c6840d28d0ae\") " pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:49.365386 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.365357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvbsl" Jul 06 20:35:49.443327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.443294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:49.446806 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.446781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:35:49.457442 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.457419 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:35:49.467583 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.467555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9v67\" (UniqueName: \"kubernetes.io/projected/42928fd1-1a1a-4fad-916e-93bbaaa0f639-kube-api-access-q9v67\") pod \"network-check-target-6vbfp\" (UID: \"42928fd1-1a1a-4fad-916e-93bbaaa0f639\") " pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:49.493343 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.493291 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvbsl"] Jul 06 20:35:49.497727 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:35:49.497692 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809917ad_8294_4c00_826e_c6840d28d0ae.slice/crio-d531ac04ca8ae976f82aed4291d972898a062c29d810adb591572f204136c3b4 WatchSource:0}: Error finding container d531ac04ca8ae976f82aed4291d972898a062c29d810adb591572f204136c3b4: Status 404 returned error can't find the container with id d531ac04ca8ae976f82aed4291d972898a062c29d810adb591572f204136c3b4 Jul 06 20:35:49.673366 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.673285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pf4w\"" Jul 06 20:35:49.680772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.680746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:49.811172 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.811026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6vbfp"] Jul 06 20:35:49.813410 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:35:49.813388 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42928fd1_1a1a_4fad_916e_93bbaaa0f639.slice/crio-ad5a1e3dbd371506546b4d5d079019eec157c54bac78fd28679ee55e1c313e28 WatchSource:0}: Error finding container ad5a1e3dbd371506546b4d5d079019eec157c54bac78fd28679ee55e1c313e28: Status 404 returned error can't find the container with id ad5a1e3dbd371506546b4d5d079019eec157c54bac78fd28679ee55e1c313e28 Jul 06 20:35:49.982087 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.981984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6vbfp" event={"ID":"42928fd1-1a1a-4fad-916e-93bbaaa0f639","Type":"ContainerStarted","Data":"ad5a1e3dbd371506546b4d5d079019eec157c54bac78fd28679ee55e1c313e28"} Jul 06 20:35:49.982994 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:49.982971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvbsl" event={"ID":"809917ad-8294-4c00-826e-c6840d28d0ae","Type":"ContainerStarted","Data":"d531ac04ca8ae976f82aed4291d972898a062c29d810adb591572f204136c3b4"} Jul 06 20:35:50.852786 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:50.852744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:35:50.853270 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:50.852929 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:50.853270 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:50.852952 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687ffffbb6-827b6: secret "image-registry-tls" not found Jul 06 20:35:50.853270 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:50.853023 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls podName:d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:22.853003364 +0000 UTC m=+99.677307614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls") pod "image-registry-687ffffbb6-827b6" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88") : secret "image-registry-tls" not found Jul 06 20:35:50.953911 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:50.953870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:35:50.954114 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:50.953991 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:50.954114 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:50.954073 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls podName:dc0d00a7-6446-4b57-a9b8-246bddc9000e nodeName:}" failed. No retries permitted until 2026-07-06 20:36:22.954056513 +0000 UTC m=+99.778360766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls") pod "dns-default-b4h79" (UID: "dc0d00a7-6446-4b57-a9b8-246bddc9000e") : secret "dns-default-metrics-tls" not found Jul 06 20:35:54.996222 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:54.996179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6vbfp" event={"ID":"42928fd1-1a1a-4fad-916e-93bbaaa0f639","Type":"ContainerStarted","Data":"2663bdc752dd7c30521a824522ea6e6fea4f8f7a2d802f0c3d5602b8b18808be"} Jul 06 20:35:54.996741 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:54.996292 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:35:54.997566 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:54.997543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvbsl" event={"ID":"809917ad-8294-4c00-826e-c6840d28d0ae","Type":"ContainerStarted","Data":"5f8ef882f8e2ff7a467b647123b9d1e9f4491ac2b0122379d50fea7fff55038f"} Jul 06 20:35:55.034621 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:55.034456 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vvbsl" podStartSLOduration=65.919357698 podStartE2EDuration="1m11.034439391s" totalImagesPullingTime="5.115081693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:55.034303556 +0000 UTC m=+71.858607806" watchObservedRunningTime="2026-07-06 20:35:55.034439391 +0000 UTC m=+71.858743634" Jul 06 20:35:55.034855 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:55.034828 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6vbfp" podStartSLOduration=66.235612835 podStartE2EDuration="1m11.034821599s" totalImagesPullingTime="4.799208764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:55.017157681 +0000 UTC m=+71.841461934" watchObservedRunningTime="2026-07-06 20:35:55.034821599 +0000 UTC m=+71.859125850" Jul 06 20:35:58.007199 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.007169 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sxvrg"] Jul 06 20:35:58.033277 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.033239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sxvrg"] Jul 06 20:35:58.033437 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.033374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.036073 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.036050 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:35:58.036073 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.036068 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:35:58.036236 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.036068 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kstsn\"" Jul 06 20:35:58.036236 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.036055 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:35:58.037245 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.037221 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:35:58.107645 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.107610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79c72543-2029-48e9-844a-cd17bea90ce5-data-volume\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.107818 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.107655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.107818 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.107754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79c72543-2029-48e9-844a-cd17bea90ce5-crio-socket\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.107818 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.107779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.107818 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.107803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxsfm\" (UniqueName: \"kubernetes.io/projected/79c72543-2029-48e9-844a-cd17bea90ce5-kube-api-access-hxsfm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208601 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxsfm\" (UniqueName: \"kubernetes.io/projected/79c72543-2029-48e9-844a-cd17bea90ce5-kube-api-access-hxsfm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79c72543-2029-48e9-844a-cd17bea90ce5-data-volume\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208759 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79c72543-2029-48e9-844a-cd17bea90ce5-crio-socket\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208759 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208834 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.208781 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:35:58.208834 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79c72543-2029-48e9-844a-cd17bea90ce5-crio-socket\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.208901 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.208853 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:58.708831128 +0000 UTC m=+75.533135359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:35:58.208901 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.208782 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:35:58.208978 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.208932 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:58.708920182 +0000 UTC m=+75.533224413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : configmap "kube-rbac-proxy" not found Jul 06 20:35:58.209014 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.208988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79c72543-2029-48e9-844a-cd17bea90ce5-data-volume\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.220638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.220613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxsfm\" (UniqueName: \"kubernetes.io/projected/79c72543-2029-48e9-844a-cd17bea90ce5-kube-api-access-hxsfm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.712715 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.712670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.712905 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:58.712731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:58.712905 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.712789 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:35:58.712905 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.712844 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:35:58.712905 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.712863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:59.712848652 +0000 UTC m=+76.537152883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : configmap "kube-rbac-proxy" not found Jul 06 20:35:58.712905 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:58.712881 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:59.712870653 +0000 UTC m=+76.537174883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:35:59.720914 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:59.720866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:59.721323 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:35:59.720958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:35:59.721323 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:59.721016 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:35:59.721323 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:59.721019 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:35:59.721323 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:59.721075 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:01.721061838 +0000 UTC m=+78.545366069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : configmap "kube-rbac-proxy" not found Jul 06 20:35:59.721323 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:35:59.721088 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:01.721083087 +0000 UTC m=+78.545387316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:00.192069 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:00.192040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w7j9k_ee292b2f-f27c-4bfa-bdab-cabf5ddbef81/dns-node-resolver/0.log" Jul 06 20:36:00.789002 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:00.788974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qt77r_9136d806-1d82-4d85-97a2-061188be0c8b/node-ca/0.log" Jul 06 20:36:01.387568 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:01.387543 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sjhf_59edef18-394d-4f0f-a538-916ec76d5482/serve-healthcheck-canary/0.log" Jul 06 20:36:01.737875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:01.737783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:01.738017 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:01.737890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:01.738017 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:01.737939 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:01.738017 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:01.737957 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:36:01.738017 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:01.738009 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:05.737991088 +0000 UTC m=+82.562295332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:01.738162 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:01.738027 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:05.738018893 +0000 UTC m=+82.562323125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : configmap "kube-rbac-proxy" not found Jul 06 20:36:03.735709 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.735677 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2fq29"] Jul 06 20:36:03.738484 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.738464 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.741802 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.741775 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:36:03.742010 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.741997 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 20:36:03.743159 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.743143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5nm6d\"" Jul 06 20:36:03.744705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.744686 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 20:36:03.744796 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.744715 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 20:36:03.747600 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.747579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 20:36:03.753009 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.752986 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2fq29"] Jul 06 20:36:03.851541 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.851480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pz44\" (UniqueName: \"kubernetes.io/projected/8bba3a66-492f-4dd8-ad9e-7353a216c553-kube-api-access-6pz44\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.851714 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.851574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bba3a66-492f-4dd8-ad9e-7353a216c553-config\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.851714 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.851617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8bba3a66-492f-4dd8-ad9e-7353a216c553-serving-cert\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.851714 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.851637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8bba3a66-492f-4dd8-ad9e-7353a216c553-trusted-ca\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.952765 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.952721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz44\" (UniqueName: \"kubernetes.io/projected/8bba3a66-492f-4dd8-ad9e-7353a216c553-kube-api-access-6pz44\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.952765 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.952777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bba3a66-492f-4dd8-ad9e-7353a216c553-config\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.952954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.952922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8bba3a66-492f-4dd8-ad9e-7353a216c553-serving-cert\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.952954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.952948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8bba3a66-492f-4dd8-ad9e-7353a216c553-trusted-ca\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.953646 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.953622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bba3a66-492f-4dd8-ad9e-7353a216c553-config\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.953730 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.953716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8bba3a66-492f-4dd8-ad9e-7353a216c553-trusted-ca\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.955338 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.955319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8bba3a66-492f-4dd8-ad9e-7353a216c553-serving-cert\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:03.963299 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:03.963268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pz44\" (UniqueName: \"kubernetes.io/projected/8bba3a66-492f-4dd8-ad9e-7353a216c553-kube-api-access-6pz44\") pod \"console-operator-68b757fb67-2fq29\" (UID: \"8bba3a66-492f-4dd8-ad9e-7353a216c553\") " pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:04.048436 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:04.048399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:04.180121 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:04.180085 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2fq29"] Jul 06 20:36:04.183431 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:04.183400 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bba3a66_492f_4dd8_ad9e_7353a216c553.slice/crio-b7c60ea3da29ed554a13921ec5641e4ee93b8ecff7f3b3995b259ab91a4a5a1e WatchSource:0}: Error finding container b7c60ea3da29ed554a13921ec5641e4ee93b8ecff7f3b3995b259ab91a4a5a1e: Status 404 returned error can't find the container with id b7c60ea3da29ed554a13921ec5641e4ee93b8ecff7f3b3995b259ab91a4a5a1e Jul 06 20:36:05.021922 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:05.021799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" event={"ID":"8bba3a66-492f-4dd8-ad9e-7353a216c553","Type":"ContainerStarted","Data":"b7c60ea3da29ed554a13921ec5641e4ee93b8ecff7f3b3995b259ab91a4a5a1e"} Jul 06 20:36:05.766683 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:05.766647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:05.766867 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:05.766702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:05.766867 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:05.766791 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:36:05.766867 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:05.766819 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:05.766987 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:05.766869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:13.766851289 +0000 UTC m=+90.591155520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:05.766987 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:05.766892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:13.766880913 +0000 UTC m=+90.591185148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : configmap "kube-rbac-proxy" not found Jul 06 20:36:07.029128 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:07.029102 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/0.log" Jul 06 20:36:07.029488 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:07.029140 2578 generic.go:356] "Generic (PLEG): container finished" podID="8bba3a66-492f-4dd8-ad9e-7353a216c553" containerID="78a0d69e6460f6cb640ebf000e3ecfadb0f2c3f5f26ef27b99ad627d7b386b97" exitCode=255 Jul 06 20:36:07.029488 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:07.029169 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" event={"ID":"8bba3a66-492f-4dd8-ad9e-7353a216c553","Type":"ContainerDied","Data":"78a0d69e6460f6cb640ebf000e3ecfadb0f2c3f5f26ef27b99ad627d7b386b97"} Jul 06 20:36:07.029488 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:07.029394 2578 scope.go:117] "RemoveContainer" containerID="78a0d69e6460f6cb640ebf000e3ecfadb0f2c3f5f26ef27b99ad627d7b386b97" Jul 06 20:36:08.035477 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.035450 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:36:08.035873 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.035847 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/0.log" Jul 06 20:36:08.035914 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.035879 2578 generic.go:356] "Generic (PLEG): container finished" podID="8bba3a66-492f-4dd8-ad9e-7353a216c553" containerID="635e984318f365e7283b4702dd9679d87d1a8603a4f307e6f3d925f7bbebf8c2" exitCode=255 Jul 06 20:36:08.035914 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.035906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" event={"ID":"8bba3a66-492f-4dd8-ad9e-7353a216c553","Type":"ContainerDied","Data":"635e984318f365e7283b4702dd9679d87d1a8603a4f307e6f3d925f7bbebf8c2"} Jul 06 20:36:08.035973 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.035944 2578 scope.go:117] "RemoveContainer" containerID="78a0d69e6460f6cb640ebf000e3ecfadb0f2c3f5f26ef27b99ad627d7b386b97" Jul 06 20:36:08.036192 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.036175 2578 scope.go:117] "RemoveContainer" containerID="635e984318f365e7283b4702dd9679d87d1a8603a4f307e6f3d925f7bbebf8c2" Jul 06 20:36:08.036365 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:08.036346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2fq29_openshift-console-operator(8bba3a66-492f-4dd8-ad9e-7353a216c553)\"" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" podUID="8bba3a66-492f-4dd8-ad9e-7353a216c553" Jul 06 20:36:08.206743 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.206710 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5"] Jul 06 20:36:08.210810 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.210793 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" Jul 06 20:36:08.216823 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.216789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 20:36:08.216968 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.216850 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 20:36:08.217734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.217712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b7bbr\"" Jul 06 20:36:08.224793 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.224765 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5"] Jul 06 20:36:08.285677 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.285587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2gwl\" (UniqueName: \"kubernetes.io/projected/55e50973-3597-44ef-a697-1791feec67a3-kube-api-access-h2gwl\") pod \"migrator-d57d58cc9-2zvx5\" (UID: \"55e50973-3597-44ef-a697-1791feec67a3\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" Jul 06 20:36:08.386621 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.386578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2gwl\" (UniqueName: \"kubernetes.io/projected/55e50973-3597-44ef-a697-1791feec67a3-kube-api-access-h2gwl\") pod \"migrator-d57d58cc9-2zvx5\" (UID: \"55e50973-3597-44ef-a697-1791feec67a3\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" Jul 06 20:36:08.412398 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.412375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2gwl\" (UniqueName: \"kubernetes.io/projected/55e50973-3597-44ef-a697-1791feec67a3-kube-api-access-h2gwl\") pod \"migrator-d57d58cc9-2zvx5\" (UID: \"55e50973-3597-44ef-a697-1791feec67a3\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" Jul 06 20:36:08.521885 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.521846 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" Jul 06 20:36:08.649754 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:08.649716 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5"] Jul 06 20:36:08.652733 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:08.652704 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e50973_3597_44ef_a697_1791feec67a3.slice/crio-a25d4b2f55c465cf0764e3401f4660123eea446107d138c0d5f5326ffee1f8dc WatchSource:0}: Error finding container a25d4b2f55c465cf0764e3401f4660123eea446107d138c0d5f5326ffee1f8dc: Status 404 returned error can't find the container with id a25d4b2f55c465cf0764e3401f4660123eea446107d138c0d5f5326ffee1f8dc Jul 06 20:36:09.040088 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:09.040046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" event={"ID":"55e50973-3597-44ef-a697-1791feec67a3","Type":"ContainerStarted","Data":"a25d4b2f55c465cf0764e3401f4660123eea446107d138c0d5f5326ffee1f8dc"} Jul 06 20:36:09.041533 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:09.041495 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:36:09.041860 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:09.041840 2578 scope.go:117] "RemoveContainer" containerID="635e984318f365e7283b4702dd9679d87d1a8603a4f307e6f3d925f7bbebf8c2" Jul 06 20:36:09.042037 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:09.042016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2fq29_openshift-console-operator(8bba3a66-492f-4dd8-ad9e-7353a216c553)\"" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" podUID="8bba3a66-492f-4dd8-ad9e-7353a216c553" Jul 06 20:36:10.045669 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.045641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" event={"ID":"55e50973-3597-44ef-a697-1791feec67a3","Type":"ContainerStarted","Data":"b4d2b4ecfdcd2c33f23a7031ba241eb4dfbce1847ebf1f94e5095e3acf8e16d2"} Jul 06 20:36:10.612659 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.612627 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-lb5fq"] Jul 06 20:36:10.615557 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.615541 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.619847 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.619825 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 20:36:10.619982 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.619854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 20:36:10.619982 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.619855 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 20:36:10.619982 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.619856 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 20:36:10.621030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.620994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7k8z9\"" Jul 06 20:36:10.628125 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.628102 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-lb5fq"] Jul 06 20:36:10.705701 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.705661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-signing-key\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.705892 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.705717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4mw4\" (UniqueName: \"kubernetes.io/projected/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-kube-api-access-d4mw4\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.705892 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.705736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-signing-cabundle\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.807007 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.806965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-signing-key\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.807007 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.807017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4mw4\" (UniqueName: \"kubernetes.io/projected/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-kube-api-access-d4mw4\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.807242 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.807037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-signing-cabundle\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.807723 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.807704 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-signing-cabundle\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.809534 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.809497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-signing-key\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.819755 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.819733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4mw4\" (UniqueName: \"kubernetes.io/projected/c1e25cff-d25f-4c50-8c76-0b638e61c0e7-kube-api-access-d4mw4\") pod \"service-ca-758f599c5-lb5fq\" (UID: \"c1e25cff-d25f-4c50-8c76-0b638e61c0e7\") " pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:10.923976 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:10.923883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-lb5fq" Jul 06 20:36:11.050249 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:11.050217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" event={"ID":"55e50973-3597-44ef-a697-1791feec67a3","Type":"ContainerStarted","Data":"acb659c670fdb2df1975bcc16f8433804752aaa1963d1074fb8f90622832a851"} Jul 06 20:36:11.063498 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:11.063470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-lb5fq"] Jul 06 20:36:11.067822 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:11.067798 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e25cff_d25f_4c50_8c76_0b638e61c0e7.slice/crio-8b998a2af79a8d70c4567261ec6be59fbf3d07e7419f31b0ae8f2683ac026dbc WatchSource:0}: Error finding container 8b998a2af79a8d70c4567261ec6be59fbf3d07e7419f31b0ae8f2683ac026dbc: Status 404 returned error can't find the container with id 8b998a2af79a8d70c4567261ec6be59fbf3d07e7419f31b0ae8f2683ac026dbc Jul 06 20:36:11.082790 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:11.082748 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-2zvx5" podStartSLOduration=1.797412217 podStartE2EDuration="3.08273211s" totalImagesPullingTime="1.285319893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:11.081304963 +0000 UTC m=+87.905609216" watchObservedRunningTime="2026-07-06 20:36:11.08273211 +0000 UTC m=+87.907036362" Jul 06 20:36:12.055002 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:12.054960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-lb5fq" event={"ID":"c1e25cff-d25f-4c50-8c76-0b638e61c0e7","Type":"ContainerStarted","Data":"8b998a2af79a8d70c4567261ec6be59fbf3d07e7419f31b0ae8f2683ac026dbc"} Jul 06 20:36:13.060105 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:13.060018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-lb5fq" event={"ID":"c1e25cff-d25f-4c50-8c76-0b638e61c0e7","Type":"ContainerStarted","Data":"6af4966a573e3d92b98336b8491d9016cdd50cebb4e5ab6892b3bbde62a5f5f9"} Jul 06 20:36:13.080646 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:13.080596 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-lb5fq" podStartSLOduration=1.397150374 podStartE2EDuration="3.080582228s" totalImagesPullingTime="1.683431854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:13.079288968 +0000 UTC m=+89.903593220" watchObservedRunningTime="2026-07-06 20:36:13.080582228 +0000 UTC m=+89.904886459" Jul 06 20:36:13.835079 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:13.835042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:13.835278 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:13.835089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:13.835278 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:13.835189 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:13.835278 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:13.835253 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls podName:79c72543-2029-48e9-844a-cd17bea90ce5 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:29.835229014 +0000 UTC m=+106.659533246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sxvrg" (UID: "79c72543-2029-48e9-844a-cd17bea90ce5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:13.835670 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:13.835648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79c72543-2029-48e9-844a-cd17bea90ce5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:14.048783 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:14.048697 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:14.048783 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:14.048765 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:14.049228 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:14.049208 2578 scope.go:117] "RemoveContainer" containerID="635e984318f365e7283b4702dd9679d87d1a8603a4f307e6f3d925f7bbebf8c2" Jul 06 20:36:14.049430 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:14.049390 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2fq29_openshift-console-operator(8bba3a66-492f-4dd8-ad9e-7353a216c553)\"" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" podUID="8bba3a66-492f-4dd8-ad9e-7353a216c553" Jul 06 20:36:22.904898 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:22.904849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:36:22.907221 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:22.907197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"image-registry-687ffffbb6-827b6\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:36:22.970686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:22.970652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6p5d9\"" Jul 06 20:36:22.978096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:22.978071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:36:23.005632 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:23.005599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:36:23.008070 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:23.008049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc0d00a7-6446-4b57-a9b8-246bddc9000e-metrics-tls\") pod \"dns-default-b4h79\" (UID: \"dc0d00a7-6446-4b57-a9b8-246bddc9000e\") " pod="openshift-dns/dns-default-b4h79" Jul 06 20:36:23.130998 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:23.130838 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687ffffbb6-827b6"] Jul 06 20:36:23.133867 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:23.133827 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c68a87_0c25_4bf6_ad20_a7c6a9cafb88.slice/crio-f0760047d31f49d167ee68a561cbff059ef514c7ea2582c03a8496fefce6b1df WatchSource:0}: Error finding container f0760047d31f49d167ee68a561cbff059ef514c7ea2582c03a8496fefce6b1df: Status 404 returned error can't find the container with id f0760047d31f49d167ee68a561cbff059ef514c7ea2582c03a8496fefce6b1df Jul 06 20:36:23.292623 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:23.292585 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ng9hs\"" Jul 06 20:36:23.298099 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:23.298076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4h79" Jul 06 20:36:23.440729 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:23.440650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4h79"] Jul 06 20:36:23.444252 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:23.444227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0d00a7_6446_4b57_a9b8_246bddc9000e.slice/crio-2fa8dc71d4d444f7e4cb04ded87d9297bb1e73e792fc91c667e01f54454ba602 WatchSource:0}: Error finding container 2fa8dc71d4d444f7e4cb04ded87d9297bb1e73e792fc91c667e01f54454ba602: Status 404 returned error can't find the container with id 2fa8dc71d4d444f7e4cb04ded87d9297bb1e73e792fc91c667e01f54454ba602 Jul 06 20:36:24.094850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:24.094817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" event={"ID":"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88","Type":"ContainerStarted","Data":"75efa1f6b7fbe2fde377898da3bc0c3d5a456ca0d995f01050e6445cc4d92895"} Jul 06 20:36:24.095331 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:24.094870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" event={"ID":"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88","Type":"ContainerStarted","Data":"f0760047d31f49d167ee68a561cbff059ef514c7ea2582c03a8496fefce6b1df"} Jul 06 20:36:24.095331 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:24.094976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:36:24.096007 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:24.095988 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4h79" event={"ID":"dc0d00a7-6446-4b57-a9b8-246bddc9000e","Type":"ContainerStarted","Data":"2fa8dc71d4d444f7e4cb04ded87d9297bb1e73e792fc91c667e01f54454ba602"} Jul 06 20:36:24.119146 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:24.119096 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" podStartSLOduration=99.119077897 podStartE2EDuration="1m39.119077897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:24.118344291 +0000 UTC m=+100.942648545" watchObservedRunningTime="2026-07-06 20:36:24.119077897 +0000 UTC m=+100.943382149" Jul 06 20:36:26.002184 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:26.002156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6vbfp" Jul 06 20:36:26.104339 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:26.104248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4h79" event={"ID":"dc0d00a7-6446-4b57-a9b8-246bddc9000e","Type":"ContainerStarted","Data":"cee22fac54647134d3ade2f6923325369c6cab72d0f2447e261cc16dd51676e1"} Jul 06 20:36:26.104339 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:26.104300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4h79" event={"ID":"dc0d00a7-6446-4b57-a9b8-246bddc9000e","Type":"ContainerStarted","Data":"50493f146acbf54fab0e3f1d0de0375047b8e8e1720ca3fea57bd00be1163252"} Jul 06 20:36:26.104559 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:26.104384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b4h79" Jul 06 20:36:26.125560 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:26.125478 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b4h79" podStartSLOduration=65.06889876 podStartE2EDuration="1m7.125459481s" totalImagesPullingTime="2.056560721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:26.124844315 +0000 UTC m=+102.949148567" watchObservedRunningTime="2026-07-06 20:36:26.125459481 +0000 UTC m=+102.949763744" Jul 06 20:36:27.647424 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:27.647393 2578 scope.go:117] "RemoveContainer" containerID="635e984318f365e7283b4702dd9679d87d1a8603a4f307e6f3d925f7bbebf8c2" Jul 06 20:36:28.112967 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:28.112939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:36:28.113154 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:28.112986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" event={"ID":"8bba3a66-492f-4dd8-ad9e-7353a216c553","Type":"ContainerStarted","Data":"37e7f9de4109f3324d5795a1a71f71b130fb4f72437ba1911c97b7c2f37d1031"} Jul 06 20:36:28.113283 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:28.113259 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:28.135944 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:28.134785 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" podStartSLOduration=23.082557721 podStartE2EDuration="25.134763299s" totalImagesPullingTime="2.052205578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:28.133883942 +0000 UTC m=+104.958188194" watchObservedRunningTime="2026-07-06 20:36:28.134763299 +0000 UTC m=+104.959067745" Jul 06 20:36:28.140326 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:28.140300 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-2fq29" Jul 06 20:36:29.858384 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:29.858351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:29.860698 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:29.860669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79c72543-2029-48e9-844a-cd17bea90ce5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sxvrg\" (UID: \"79c72543-2029-48e9-844a-cd17bea90ce5\") " pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:30.141894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:30.141803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sxvrg" Jul 06 20:36:30.276289 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:30.276257 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sxvrg"] Jul 06 20:36:30.279070 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:30.279046 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c72543_2029_48e9_844a_cd17bea90ce5.slice/crio-f3b0e9b0dc28b324989ecc80cdf8acc11e2f9f31061af14af3bbb4a60f5eab40 WatchSource:0}: Error finding container f3b0e9b0dc28b324989ecc80cdf8acc11e2f9f31061af14af3bbb4a60f5eab40: Status 404 returned error can't find the container with id f3b0e9b0dc28b324989ecc80cdf8acc11e2f9f31061af14af3bbb4a60f5eab40 Jul 06 20:36:31.046180 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.046145 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j"] Jul 06 20:36:31.048894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.048578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" Jul 06 20:36:31.052114 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.051891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7r976\"" Jul 06 20:36:31.062197 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.062131 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j"] Jul 06 20:36:31.127681 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.127592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sxvrg" event={"ID":"79c72543-2029-48e9-844a-cd17bea90ce5","Type":"ContainerStarted","Data":"f3b0e9b0dc28b324989ecc80cdf8acc11e2f9f31061af14af3bbb4a60f5eab40"} Jul 06 20:36:31.169565 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.169455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584zh\" (UniqueName: \"kubernetes.io/projected/5656a869-e3f0-484c-a8c6-149ef6f87521-kube-api-access-584zh\") pod \"network-check-source-989f8b8dc-ktm7j\" (UID: \"5656a869-e3f0-484c-a8c6-149ef6f87521\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" Jul 06 20:36:31.270060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.270020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-584zh\" (UniqueName: \"kubernetes.io/projected/5656a869-e3f0-484c-a8c6-149ef6f87521-kube-api-access-584zh\") pod \"network-check-source-989f8b8dc-ktm7j\" (UID: \"5656a869-e3f0-484c-a8c6-149ef6f87521\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" Jul 06 20:36:31.281365 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.281326 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-584zh\" (UniqueName: \"kubernetes.io/projected/5656a869-e3f0-484c-a8c6-149ef6f87521-kube-api-access-584zh\") pod \"network-check-source-989f8b8dc-ktm7j\" (UID: \"5656a869-e3f0-484c-a8c6-149ef6f87521\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" Jul 06 20:36:31.362228 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.362143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" Jul 06 20:36:31.511630 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:31.511595 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j"] Jul 06 20:36:31.515240 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:31.515203 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5656a869_e3f0_484c_a8c6_149ef6f87521.slice/crio-d06c2d69e199b25af7d0fdf641e1a122dedcd2630d4384b5b65873f3f76e87e9 WatchSource:0}: Error finding container d06c2d69e199b25af7d0fdf641e1a122dedcd2630d4384b5b65873f3f76e87e9: Status 404 returned error can't find the container with id d06c2d69e199b25af7d0fdf641e1a122dedcd2630d4384b5b65873f3f76e87e9 Jul 06 20:36:32.132846 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:32.132798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" event={"ID":"5656a869-e3f0-484c-a8c6-149ef6f87521","Type":"ContainerStarted","Data":"53676ef688a911ef018e14c69a99a05152f646b625caefeaf4529b325b2d8c6c"} Jul 06 20:36:32.133301 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:32.132893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" event={"ID":"5656a869-e3f0-484c-a8c6-149ef6f87521","Type":"ContainerStarted","Data":"d06c2d69e199b25af7d0fdf641e1a122dedcd2630d4384b5b65873f3f76e87e9"} Jul 06 20:36:32.152472 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:32.152411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ktm7j" podStartSLOduration=1.152390432 podStartE2EDuration="1.152390432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:32.152165817 +0000 UTC m=+108.976470068" watchObservedRunningTime="2026-07-06 20:36:32.152390432 +0000 UTC m=+108.976694685" Jul 06 20:36:33.274651 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.274604 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd94d67c8-m2h2d"] Jul 06 20:36:33.281369 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.281340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.286048 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.285796 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 20:36:33.286048 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.285826 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 20:36:33.286048 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.285796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 20:36:33.286299 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.286057 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 20:36:33.286299 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.286164 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2dwz\"" Jul 06 20:36:33.286299 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.286176 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 20:36:33.286299 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.286195 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 20:36:33.286476 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.286461 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 20:36:33.291561 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.291496 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd94d67c8-m2h2d"] Jul 06 20:36:33.388591 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.388558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-service-ca\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.388591 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.388605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9xvl\" (UniqueName: \"kubernetes.io/projected/79461e61-ffb8-4bb9-81ff-738fff27c535-kube-api-access-g9xvl\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.388799 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.388668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-oauth-serving-cert\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.388799 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.388688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-serving-cert\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.388799 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.388713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-console-config\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.388799 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.388758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-oauth-config\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.489484 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.489439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-service-ca\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.489686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.489502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9xvl\" (UniqueName: \"kubernetes.io/projected/79461e61-ffb8-4bb9-81ff-738fff27c535-kube-api-access-g9xvl\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.489686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.489586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-oauth-serving-cert\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.489686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.489611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-serving-cert\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.489686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.489638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-console-config\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.490236 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.490010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-oauth-config\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.490342 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.490271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-service-ca\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.490411 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.490335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-oauth-serving-cert\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.490573 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.490552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-console-config\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.492906 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.492878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-serving-cert\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.493466 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.493447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-oauth-config\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.502098 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.502065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9xvl\" (UniqueName: \"kubernetes.io/projected/79461e61-ffb8-4bb9-81ff-738fff27c535-kube-api-access-g9xvl\") pod \"console-7dd94d67c8-m2h2d\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:33.594771 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:33.594688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:34.187922 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:34.187900 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd94d67c8-m2h2d"] Jul 06 20:36:34.192563 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:34.192535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79461e61_ffb8_4bb9_81ff_738fff27c535.slice/crio-6abed6dc867795678b75b2e71bb3f56d7b42575b3b4200badbd51c6846250a37 WatchSource:0}: Error finding container 6abed6dc867795678b75b2e71bb3f56d7b42575b3b4200badbd51c6846250a37: Status 404 returned error can't find the container with id 6abed6dc867795678b75b2e71bb3f56d7b42575b3b4200badbd51c6846250a37 Jul 06 20:36:35.145686 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:35.145595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sxvrg" event={"ID":"79c72543-2029-48e9-844a-cd17bea90ce5","Type":"ContainerStarted","Data":"7bd6b28576e501c35a4cbe29fbe9707d331f571b2441b1a0553eb683fb87641d"} Jul 06 20:36:35.146103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:35.145714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sxvrg" event={"ID":"79c72543-2029-48e9-844a-cd17bea90ce5","Type":"ContainerStarted","Data":"ead8c6b9d54b1cf8b624fe38d088dc53b8b1ee329c08897cda43b1846bd66daa"} Jul 06 20:36:35.147060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:35.147025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd94d67c8-m2h2d" event={"ID":"79461e61-ffb8-4bb9-81ff-738fff27c535","Type":"ContainerStarted","Data":"6abed6dc867795678b75b2e71bb3f56d7b42575b3b4200badbd51c6846250a37"} Jul 06 20:36:36.111491 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:36.111114 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b4h79" Jul 06 20:36:38.423822 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.423791 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz"] Jul 06 20:36:38.426885 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.426855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.429783 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.429755 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 20:36:38.429894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.429804 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:36:38.430068 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.430047 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:36:38.430194 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.430054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 20:36:38.431000 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.430973 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:36:38.431091 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.431005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fsjhw\"" Jul 06 20:36:38.440010 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.439986 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz"] Jul 06 20:36:38.536264 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.536216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.536454 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.536272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.536454 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.536343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnjwt\" (UniqueName: \"kubernetes.io/projected/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-kube-api-access-xnjwt\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.536454 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.536361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.637502 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.637412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnjwt\" (UniqueName: \"kubernetes.io/projected/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-kube-api-access-xnjwt\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.637502 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.637454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.637502 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.637495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.637784 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.637546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.637784 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:38.637624 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 20:36:38.637784 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:38.637698 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls podName:fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b nodeName:}" failed. No retries permitted until 2026-07-06 20:36:39.137677447 +0000 UTC m=+115.961981678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-whcnz" (UID: "fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b") : secret "prometheus-operator-tls" not found Jul 06 20:36:38.638223 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.638204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.640007 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.639981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:38.649800 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:38.649773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnjwt\" (UniqueName: \"kubernetes.io/projected/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-kube-api-access-xnjwt\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:39.141221 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:39.141177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:39.141441 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:39.141342 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 20:36:39.141441 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:39.141414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls podName:fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b nodeName:}" failed. No retries permitted until 2026-07-06 20:36:40.141397258 +0000 UTC m=+116.965701488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-whcnz" (UID: "fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b") : secret "prometheus-operator-tls" not found Jul 06 20:36:39.167463 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:39.167420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sxvrg" event={"ID":"79c72543-2029-48e9-844a-cd17bea90ce5","Type":"ContainerStarted","Data":"9acffba8c2fa1cacb00924406cc52c578cc486632c61299033aa008981f6fb76"} Jul 06 20:36:39.168946 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:39.168914 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd94d67c8-m2h2d" event={"ID":"79461e61-ffb8-4bb9-81ff-738fff27c535","Type":"ContainerStarted","Data":"8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e"} Jul 06 20:36:39.188980 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:39.188920 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sxvrg" podStartSLOduration=34.272538105 podStartE2EDuration="42.188904932s" totalImagesPullingTime="7.916366827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:39.188072254 +0000 UTC m=+116.012376507" watchObservedRunningTime="2026-07-06 20:36:39.188904932 +0000 UTC m=+116.013209183" Jul 06 20:36:39.209270 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:39.209221 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd94d67c8-m2h2d" podStartSLOduration=2.072378793 podStartE2EDuration="6.209201381s" totalImagesPullingTime="4.136822588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:39.208857172 +0000 UTC m=+116.033161424" watchObservedRunningTime="2026-07-06 20:36:39.209201381 +0000 UTC m=+116.033505634" Jul 06 20:36:40.147687 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:40.147651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:40.150005 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:40.149977 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-whcnz\" (UID: \"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:40.237137 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:40.237103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" Jul 06 20:36:40.369470 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:40.369437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz"] Jul 06 20:36:40.373059 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:40.373028 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccb5ad5_9cf7_45aa_b17c_ac46ea9cc79b.slice/crio-101ffbedc4687e6edbd38498be7535ab0d665f25fad722dfb60a9d048186890d WatchSource:0}: Error finding container 101ffbedc4687e6edbd38498be7535ab0d665f25fad722dfb60a9d048186890d: Status 404 returned error can't find the container with id 101ffbedc4687e6edbd38498be7535ab0d665f25fad722dfb60a9d048186890d Jul 06 20:36:41.177217 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:41.177182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" event={"ID":"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b","Type":"ContainerStarted","Data":"101ffbedc4687e6edbd38498be7535ab0d665f25fad722dfb60a9d048186890d"} Jul 06 20:36:42.182006 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:42.181974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" event={"ID":"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b","Type":"ContainerStarted","Data":"aa0a52ce4978e94cd228e490d3c1bd66e252029a7c66352afd92dd4dea6b3926"} Jul 06 20:36:42.182378 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:42.182034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" event={"ID":"fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b","Type":"ContainerStarted","Data":"a827172367991cf75289b5a17910ca9153cd5dd897446a38e3624dbcafb84336"} Jul 06 20:36:42.202408 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:42.202345 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-whcnz" podStartSLOduration=2.989792934 podStartE2EDuration="4.202323472s" totalImagesPullingTime="1.212530538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:42.202165226 +0000 UTC m=+119.026469478" watchObservedRunningTime="2026-07-06 20:36:42.202323472 +0000 UTC m=+119.026627724" Jul 06 20:36:42.983215 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:42.983181 2578 patch_prober.go:28] interesting pod/image-registry-687ffffbb6-827b6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 20:36:42.983369 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:42.983239 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" podUID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:36:43.448602 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.448566 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98744456f-h9rxr"] Jul 06 20:36:43.451637 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.451616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.459980 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.459956 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 20:36:43.465010 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.464980 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98744456f-h9rxr"] Jul 06 20:36:43.575327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-oauth-serving-cert\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.575499 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-trusted-ca-bundle\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.575499 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcvj\" (UniqueName: \"kubernetes.io/projected/49eb654c-f5f0-4b57-93aa-03eda8ade241-kube-api-access-gtcvj\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.575499 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-serving-cert\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.575677 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-oauth-config\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.575677 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-config\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.575677 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.575647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-service-ca\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.595703 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.595670 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:43.595867 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.595730 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:43.600336 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.600308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:43.676864 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.676826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-serving-cert\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.676906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-oauth-config\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.676935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-config\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.676960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-service-ca\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.677001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-oauth-serving-cert\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.677024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-trusted-ca-bundle\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677063 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.677062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcvj\" (UniqueName: \"kubernetes.io/projected/49eb654c-f5f0-4b57-93aa-03eda8ade241-kube-api-access-gtcvj\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.677927 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.677897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-service-ca\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.678046 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.677964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-oauth-serving-cert\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.678046 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.678021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-config\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.679479 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.679454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-oauth-config\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.679581 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.679553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-serving-cert\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.687265 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.687242 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 20:36:43.690446 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.690423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcvj\" (UniqueName: \"kubernetes.io/projected/49eb654c-f5f0-4b57-93aa-03eda8ade241-kube-api-access-gtcvj\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.698974 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.698916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-trusted-ca-bundle\") pod \"console-98744456f-h9rxr\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.760672 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.760637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:43.871332 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.870642 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv"] Jul 06 20:36:43.880313 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.879369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:43.883084 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.883050 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 20:36:43.883230 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.883101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xs6c9\"" Jul 06 20:36:43.883383 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.883364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:36:43.895064 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.895023 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv"] Jul 06 20:36:43.896751 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.896714 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c8rvq"] Jul 06 20:36:43.900829 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.900801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:43.907197 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.907148 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-km4wm\"" Jul 06 20:36:43.907715 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.907696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:36:43.907831 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.907757 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:36:43.908146 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.908127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:36:43.933038 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.933009 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98744456f-h9rxr"] Jul 06 20:36:43.937347 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:43.937321 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49eb654c_f5f0_4b57_93aa_03eda8ade241.slice/crio-6891da0ee7a8be7f765f3ee4c695879f283e16c4c09f8e758e6f02853c428886 WatchSource:0}: Error finding container 6891da0ee7a8be7f765f3ee4c695879f283e16c4c09f8e758e6f02853c428886: Status 404 returned error can't find the container with id 6891da0ee7a8be7f765f3ee4c695879f283e16c4c09f8e758e6f02853c428886 Jul 06 20:36:43.979609 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.979578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:43.979766 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.979723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf67k\" (UniqueName: \"kubernetes.io/projected/5d287392-ad49-4066-a4d5-b7cb1d6a1301-kube-api-access-wf67k\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:43.979825 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.979764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d287392-ad49-4066-a4d5-b7cb1d6a1301-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:43.979825 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:43.979794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.081008 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.080964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-wtmp\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-tls\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-metrics-client-ca\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf67k\" (UniqueName: \"kubernetes.io/projected/5d287392-ad49-4066-a4d5-b7cb1d6a1301-kube-api-access-wf67k\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d287392-ad49-4066-a4d5-b7cb1d6a1301-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-sys\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-root\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7fmx\" (UniqueName: \"kubernetes.io/projected/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-kube-api-access-r7fmx\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.081747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-textfile\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:44.081805 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:44.081886 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-tls podName:5d287392-ad49-4066-a4d5-b7cb1d6a1301 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:44.58186723 +0000 UTC m=+121.406171474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-82gmv" (UID: "5d287392-ad49-4066-a4d5-b7cb1d6a1301") : secret "openshift-state-metrics-tls" not found Jul 06 20:36:44.083151 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.082894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d287392-ad49-4066-a4d5-b7cb1d6a1301-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.084201 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.084181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.094856 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.094832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf67k\" (UniqueName: \"kubernetes.io/projected/5d287392-ad49-4066-a4d5-b7cb1d6a1301-kube-api-access-wf67k\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.182884 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.182845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183072 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.182910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183072 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.182939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7fmx\" (UniqueName: \"kubernetes.io/projected/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-kube-api-access-r7fmx\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183072 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.182969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-textfile\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183072 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-wtmp\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183072 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-tls\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183333 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-metrics-client-ca\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183333 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-sys\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183333 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-root\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183333 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-root\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183562 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-wtmp\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.183870 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.183848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.184078 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.184058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-textfile\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.184156 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.184123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-sys\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.184638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.184616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-metrics-client-ca\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.188058 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.187453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.188058 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.187940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-node-exporter-tls\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.191892 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.191772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98744456f-h9rxr" event={"ID":"49eb654c-f5f0-4b57-93aa-03eda8ade241","Type":"ContainerStarted","Data":"572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0"} Jul 06 20:36:44.191892 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.191862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98744456f-h9rxr" event={"ID":"49eb654c-f5f0-4b57-93aa-03eda8ade241","Type":"ContainerStarted","Data":"6891da0ee7a8be7f765f3ee4c695879f283e16c4c09f8e758e6f02853c428886"} Jul 06 20:36:44.194744 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.194719 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7fmx\" (UniqueName: \"kubernetes.io/projected/b9a3a815-9c6b-49f1-9a78-b08adfbad65d-kube-api-access-r7fmx\") pod \"node-exporter-c8rvq\" (UID: \"b9a3a815-9c6b-49f1-9a78-b08adfbad65d\") " pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.196075 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.196059 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:36:44.213170 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.213074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8rvq" Jul 06 20:36:44.214737 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.214697 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98744456f-h9rxr" podStartSLOduration=1.214682807 podStartE2EDuration="1.214682807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:44.213857459 +0000 UTC m=+121.038161708" watchObservedRunningTime="2026-07-06 20:36:44.214682807 +0000 UTC m=+121.038987059" Jul 06 20:36:44.225316 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:44.225288 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a3a815_9c6b_49f1_9a78_b08adfbad65d.slice/crio-566419cfc3c284e900d18d4fe3471f7dfe0d429af5b6b2fa54e4a3c680751df2 WatchSource:0}: Error finding container 566419cfc3c284e900d18d4fe3471f7dfe0d429af5b6b2fa54e4a3c680751df2: Status 404 returned error can't find the container with id 566419cfc3c284e900d18d4fe3471f7dfe0d429af5b6b2fa54e4a3c680751df2 Jul 06 20:36:44.586676 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.586637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.589087 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.589063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d287392-ad49-4066-a4d5-b7cb1d6a1301-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-82gmv\" (UID: \"5d287392-ad49-4066-a4d5-b7cb1d6a1301\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.791755 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.791717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" Jul 06 20:36:44.956622 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.956583 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:36:44.961756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.961729 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv"] Jul 06 20:36:44.961913 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.961887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:44.965564 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:36:44.965564 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:36:44.965564 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:36:44.965564 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:36:44.965564 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:36:44.965564 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965507 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p9k57\"" Jul 06 20:36:44.965934 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:36:44.965934 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:36:44.966030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.966005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:36:44.966124 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.965509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:36:44.976903 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:44.976871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:36:45.092398 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjwhj\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-kube-api-access-xjwhj\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-web-config\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092920 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-config-out\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092920 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092920 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092920 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.092920 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.092770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.104313 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.104105 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:36:45.118221 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:45.118149 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d287392_ad49_4066_a4d5_b7cb1d6a1301.slice/crio-902053060aef59a52d60c199369cb13130d773608ad49b142b3a19c7966dd111 WatchSource:0}: Error finding container 902053060aef59a52d60c199369cb13130d773608ad49b142b3a19c7966dd111: Status 404 returned error can't find the container with id 902053060aef59a52d60c199369cb13130d773608ad49b142b3a19c7966dd111 Jul 06 20:36:45.193493 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193493 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-web-config\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-config-out\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.193696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.194027 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjwhj\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-kube-api-access-xjwhj\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.194027 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.194027 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.194027 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.193785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.194027 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:45.193948 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle podName:4c616a13-acea-496d-b696-1c15969eff50 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:45.693927123 +0000 UTC m=+122.518231356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4c616a13-acea-496d-b696-1c15969eff50") : configmap references non-existent config key: ca-bundle.crt Jul 06 20:36:45.195395 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.195217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.196058 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:45.195997 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 20:36:45.196153 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:36:45.196094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls podName:4c616a13-acea-496d-b696-1c15969eff50 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:45.696073754 +0000 UTC m=+122.520377998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4c616a13-acea-496d-b696-1c15969eff50") : secret "alertmanager-main-tls" not found Jul 06 20:36:45.197380 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.196765 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.197850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.197783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.198417 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.198267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.198703 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.198665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-config-out\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.198928 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.198902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.199667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.199632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" event={"ID":"5d287392-ad49-4066-a4d5-b7cb1d6a1301","Type":"ContainerStarted","Data":"e35c411d9ae18deb3e35e801749df6e23438055d3e9e764bd2bcc49218850f09"} Jul 06 20:36:45.199667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.199709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" event={"ID":"5d287392-ad49-4066-a4d5-b7cb1d6a1301","Type":"ContainerStarted","Data":"902053060aef59a52d60c199369cb13130d773608ad49b142b3a19c7966dd111"} Jul 06 20:36:45.200753 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.200381 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.200894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.200804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-web-config\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.201120 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.201030 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.201120 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.201037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.202044 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.202019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8rvq" event={"ID":"b9a3a815-9c6b-49f1-9a78-b08adfbad65d","Type":"ContainerStarted","Data":"566419cfc3c284e900d18d4fe3471f7dfe0d429af5b6b2fa54e4a3c680751df2"} Jul 06 20:36:45.206730 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.206439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjwhj\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-kube-api-access-xjwhj\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.699168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.699105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.699168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.699151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.700166 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.700145 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.701702 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.701667 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.874960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.874919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:36:45.896707 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.896671 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-87c9b7bb7-2z64x"] Jul 06 20:36:45.903171 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.903137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:45.914296 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.914267 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8ec638nfabn8b\"" Jul 06 20:36:45.914558 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.914448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:36:45.914653 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.914630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:36:45.914947 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.914907 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:36:45.915009 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.914976 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:36:45.915329 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.915307 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:36:45.915915 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.915896 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d95bn\"" Jul 06 20:36:45.921170 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:45.921143 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-87c9b7bb7-2z64x"] Jul 06 20:36:46.001269 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001426 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-tls\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001426 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001569 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkfph\" (UniqueName: \"kubernetes.io/projected/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-kube-api-access-lkfph\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001569 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001569 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-metrics-client-ca\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-grpc-tls\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.001713 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.001629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.062344 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.062312 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:36:46.065744 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:46.065717 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c616a13_acea_496d_b696_1c15969eff50.slice/crio-671ea82e59c5fbe6a17543c194c35b32dc5398fd8c568862ad8c930101282320 WatchSource:0}: Error finding container 671ea82e59c5fbe6a17543c194c35b32dc5398fd8c568862ad8c930101282320: Status 404 returned error can't find the container with id 671ea82e59c5fbe6a17543c194c35b32dc5398fd8c568862ad8c930101282320 Jul 06 20:36:46.102612 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.102808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkfph\" (UniqueName: \"kubernetes.io/projected/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-kube-api-access-lkfph\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.102808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.102808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-metrics-client-ca\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.102808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-grpc-tls\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.102808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.103043 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.103043 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.102856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-tls\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.104194 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.104135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-metrics-client-ca\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.105911 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.105855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-tls\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.106160 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.106135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.106657 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.106624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-grpc-tls\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.106756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.106628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.106756 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.106747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.106848 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.106768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.121625 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.121594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkfph\" (UniqueName: \"kubernetes.io/projected/5a238a13-f9dd-4a25-a1b6-ed4d3725e20c-kube-api-access-lkfph\") pod \"thanos-querier-87c9b7bb7-2z64x\" (UID: \"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c\") " pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.208028 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.207985 2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a3a815-9c6b-49f1-9a78-b08adfbad65d" containerID="b8c3a6d49d0935095f3c9154de248738d3b16236479b89a66b4b3c8a5493455d" exitCode=0 Jul 06 20:36:46.208206 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.208042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8rvq" event={"ID":"b9a3a815-9c6b-49f1-9a78-b08adfbad65d","Type":"ContainerDied","Data":"b8c3a6d49d0935095f3c9154de248738d3b16236479b89a66b4b3c8a5493455d"} Jul 06 20:36:46.209441 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.209415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"671ea82e59c5fbe6a17543c194c35b32dc5398fd8c568862ad8c930101282320"} Jul 06 20:36:46.211542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.211502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" event={"ID":"5d287392-ad49-4066-a4d5-b7cb1d6a1301","Type":"ContainerStarted","Data":"45ecdbaff8ec39618fdb01394e878f0509370a2a8f313c25dce29bfbc47b99ea"} Jul 06 20:36:46.218501 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.218476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:46.496839 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:46.496810 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-87c9b7bb7-2z64x"] Jul 06 20:36:46.501590 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:46.501358 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a238a13_f9dd_4a25_a1b6_ed4d3725e20c.slice/crio-6e62abab18a9d035f9f1f532b793a4cf313b33b5d4889c0e57e703101ba283f5 WatchSource:0}: Error finding container 6e62abab18a9d035f9f1f532b793a4cf313b33b5d4889c0e57e703101ba283f5: Status 404 returned error can't find the container with id 6e62abab18a9d035f9f1f532b793a4cf313b33b5d4889c0e57e703101ba283f5 Jul 06 20:36:47.218919 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:47.218876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" event={"ID":"5d287392-ad49-4066-a4d5-b7cb1d6a1301","Type":"ContainerStarted","Data":"b66fdd9d8406fd151ecd0a18f7d09c4f4ab0fe8ec1eb2e73d9b6eb82c3255481"} Jul 06 20:36:47.222689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:47.222593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8rvq" event={"ID":"b9a3a815-9c6b-49f1-9a78-b08adfbad65d","Type":"ContainerStarted","Data":"e1eefd8e55d881c344ea10b4b25c80a5e0692dfa714a8139e134265c5d6388d8"} Jul 06 20:36:47.222689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:47.222652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8rvq" event={"ID":"b9a3a815-9c6b-49f1-9a78-b08adfbad65d","Type":"ContainerStarted","Data":"5af0261422b08d98ccdcc6e6db5b8db9466d9d0c949c29e018ba423c3e1fb740"} Jul 06 20:36:47.224039 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:47.223992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"6e62abab18a9d035f9f1f532b793a4cf313b33b5d4889c0e57e703101ba283f5"} Jul 06 20:36:47.242367 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:47.242300 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-82gmv" podStartSLOduration=3.095236072 podStartE2EDuration="4.24227587s" totalImagesPullingTime="1.147039798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:47.241464424 +0000 UTC m=+124.065768676" watchObservedRunningTime="2026-07-06 20:36:47.24227587 +0000 UTC m=+124.066580123" Jul 06 20:36:47.275046 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:47.274992 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c8rvq" podStartSLOduration=3.254627097 podStartE2EDuration="4.274972674s" totalImagesPullingTime="941.876183ms" totalInitContainerRuntime="78.469394ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:47.273989345 +0000 UTC m=+124.098293599" watchObservedRunningTime="2026-07-06 20:36:47.274972674 +0000 UTC m=+124.099276926" Jul 06 20:36:48.230768 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.230736 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="1889cc9dfa4a96f4a3d74216e57345059b0c57b7d45284ced9bd555a4e84468b" exitCode=0 Jul 06 20:36:48.231179 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.231046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"1889cc9dfa4a96f4a3d74216e57345059b0c57b7d45284ced9bd555a4e84468b"} Jul 06 20:36:48.232800 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.232736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"888bc34c212c8d19926f4e98eacd85ab62c66180eb75e2f87a33e807ef7e979f"} Jul 06 20:36:48.337899 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.337868 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-555944bbd6-wjn7j"] Jul 06 20:36:48.342279 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.342258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.345199 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.345164 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 20:36:48.345199 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.345178 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 20:36:48.345346 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.345226 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:36:48.345346 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.345263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-144svouonnmbn\"" Jul 06 20:36:48.345626 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.345606 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 20:36:48.345708 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.345632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lqn8d\"" Jul 06 20:36:48.354216 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.354194 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-555944bbd6-wjn7j"] Jul 06 20:36:48.425408 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fd034e-4916-40e1-843c-89bf1f1406a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.425408 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30fd034e-4916-40e1-843c-89bf1f1406a6-metrics-server-audit-profiles\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.425408 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7v6q\" (UniqueName: \"kubernetes.io/projected/30fd034e-4916-40e1-843c-89bf1f1406a6-kube-api-access-h7v6q\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.425674 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-secret-metrics-server-tls\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.425674 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-secret-metrics-server-client-certs\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.425674 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-client-ca-bundle\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.425674 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.425625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30fd034e-4916-40e1-843c-89bf1f1406a6-audit-log\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526070 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fd034e-4916-40e1-843c-89bf1f1406a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526270 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30fd034e-4916-40e1-843c-89bf1f1406a6-metrics-server-audit-profiles\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526270 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v6q\" (UniqueName: \"kubernetes.io/projected/30fd034e-4916-40e1-843c-89bf1f1406a6-kube-api-access-h7v6q\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526270 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-secret-metrics-server-tls\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526419 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-secret-metrics-server-client-certs\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526419 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-client-ca-bundle\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526419 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30fd034e-4916-40e1-843c-89bf1f1406a6-audit-log\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.526766 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.526736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30fd034e-4916-40e1-843c-89bf1f1406a6-audit-log\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.527279 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.527260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30fd034e-4916-40e1-843c-89bf1f1406a6-metrics-server-audit-profiles\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.527404 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.527380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fd034e-4916-40e1-843c-89bf1f1406a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.529149 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.529121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-client-ca-bundle\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.529230 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.529170 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-secret-metrics-server-tls\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.529271 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.529249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30fd034e-4916-40e1-843c-89bf1f1406a6-secret-metrics-server-client-certs\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.539015 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.538991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7v6q\" (UniqueName: \"kubernetes.io/projected/30fd034e-4916-40e1-843c-89bf1f1406a6-kube-api-access-h7v6q\") pod \"metrics-server-555944bbd6-wjn7j\" (UID: \"30fd034e-4916-40e1-843c-89bf1f1406a6\") " pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.652465 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.652426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:36:48.791098 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:48.791069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-555944bbd6-wjn7j"] Jul 06 20:36:48.793669 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:48.793641 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fd034e_4916_40e1_843c_89bf1f1406a6.slice/crio-27fa7f69c9af12ece7f8b5a02196de5fc918bb4ceea586b4cb3a6fcd1a23e90a WatchSource:0}: Error finding container 27fa7f69c9af12ece7f8b5a02196de5fc918bb4ceea586b4cb3a6fcd1a23e90a: Status 404 returned error can't find the container with id 27fa7f69c9af12ece7f8b5a02196de5fc918bb4ceea586b4cb3a6fcd1a23e90a Jul 06 20:36:49.129213 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.129183 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk"] Jul 06 20:36:49.132576 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.132549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.135535 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.135492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ljzl6\"" Jul 06 20:36:49.135835 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.135800 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 20:36:49.135835 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.135820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 20:36:49.135835 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.135828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 20:36:49.136045 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.135997 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 20:36:49.136099 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.136083 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 20:36:49.143275 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.143249 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 20:36:49.146909 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.146875 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk"] Jul 06 20:36:49.234103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-serving-certs-ca-bundle\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-metrics-client-ca\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktsh\" (UniqueName: \"kubernetes.io/projected/37747521-9d09-4073-a3c7-0a84e32a6410-kube-api-access-tktsh\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-telemeter-client-tls\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-secret-telemeter-client\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-federate-client-tls\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.234542 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.234373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.240915 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.240838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" event={"ID":"30fd034e-4916-40e1-843c-89bf1f1406a6","Type":"ContainerStarted","Data":"27fa7f69c9af12ece7f8b5a02196de5fc918bb4ceea586b4cb3a6fcd1a23e90a"} Jul 06 20:36:49.245226 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.245151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"2ee762064d0311d4afb847de595583abae25333480fefaab83a82c832c95dd02"} Jul 06 20:36:49.245353 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.245234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"d880c95c6744d5b28caa45d5a5042e1aa6f5d3a9814ad4dec187674cbe957824"} Jul 06 20:36:49.245353 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.245267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"80dacf6a793d07535c725e9afeef64d137ad1ce6f4d74d5d46d199dcd65caa15"} Jul 06 20:36:49.335407 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-serving-certs-ca-bundle\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-metrics-client-ca\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tktsh\" (UniqueName: \"kubernetes.io/projected/37747521-9d09-4073-a3c7-0a84e32a6410-kube-api-access-tktsh\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335649 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-telemeter-client-tls\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335989 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-secret-telemeter-client\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.335989 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.335742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-federate-client-tls\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.336437 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.336385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.337127 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.337089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-metrics-client-ca\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.337771 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.337744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37747521-9d09-4073-a3c7-0a84e32a6410-serving-certs-ca-bundle\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.339172 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.339121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-federate-client-tls\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.340832 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.340787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.340932 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.340902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-telemeter-client-tls\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.342481 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.342456 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/37747521-9d09-4073-a3c7-0a84e32a6410-secret-telemeter-client\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.349692 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.349657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktsh\" (UniqueName: \"kubernetes.io/projected/37747521-9d09-4073-a3c7-0a84e32a6410-kube-api-access-tktsh\") pod \"telemeter-client-56b95fbb4c-qpmxk\" (UID: \"37747521-9d09-4073-a3c7-0a84e32a6410\") " pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.447421 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.447377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" Jul 06 20:36:49.613386 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:49.613356 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk"] Jul 06 20:36:49.848578 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:49.848544 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37747521_9d09_4073_a3c7_0a84e32a6410.slice/crio-a7d8b3aedaffec700492691783c9fded5f5945469438b6e1f67698303ff3acf9 WatchSource:0}: Error finding container a7d8b3aedaffec700492691783c9fded5f5945469438b6e1f67698303ff3acf9: Status 404 returned error can't find the container with id a7d8b3aedaffec700492691783c9fded5f5945469438b6e1f67698303ff3acf9 Jul 06 20:36:50.224400 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.224313 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:36:50.228771 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.228739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.233726 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.233549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:36:50.233870 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.233846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:36:50.233939 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.233875 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ccxpt\"" Jul 06 20:36:50.233939 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.233900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:36:50.234041 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.233850 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:36:50.234041 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.233958 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:36:50.240863 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.235309 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:36:50.240863 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.235722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:36:50.240863 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.236088 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:36:50.240863 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.236732 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:36:50.243055 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.243036 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:36:50.243268 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.243246 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:36:50.244241 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.244220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:36:50.245028 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.244994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.245174 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.245154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.245320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.245304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.245797 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.245769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.245975 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.245958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246114 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246365 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246495 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246640 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bkg\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-kube-api-access-k4bkg\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246781 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.246894 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.247096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.247096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.247096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.247096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.246983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.247096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.247027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.247096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.245865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:36:50.247673 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.245904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6bs6tss69aare\"" Jul 06 20:36:50.249308 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.249283 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:36:50.250424 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.250392 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:36:50.257797 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.257760 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"b51d3e22d2c3dc5549b967066a03eef0d48a51e305736800fd31e4a0571361d6"} Jul 06 20:36:50.257988 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.257857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" event={"ID":"5a238a13-f9dd-4a25-a1b6-ed4d3725e20c","Type":"ContainerStarted","Data":"5aa5f0e872e009b254c160a387e95d60e202bcb14c6f884c66efb6785a52176d"} Jul 06 20:36:50.258614 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.258594 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:50.260606 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.260510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" event={"ID":"37747521-9d09-4073-a3c7-0a84e32a6410","Type":"ContainerStarted","Data":"a7d8b3aedaffec700492691783c9fded5f5945469438b6e1f67698303ff3acf9"} Jul 06 20:36:50.300610 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.300472 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" podStartSLOduration=2.861266695 podStartE2EDuration="5.300449426s" totalImagesPullingTime="2.439182731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:50.299799809 +0000 UTC m=+127.124104062" watchObservedRunningTime="2026-07-06 20:36:50.300449426 +0000 UTC m=+127.124753679" Jul 06 20:36:50.348084 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.348084 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.348338 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.348338 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.348338 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.348338 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.348952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bkg\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-kube-api-access-k4bkg\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.349857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.349552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.351986 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.351383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.351986 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.351666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.352123 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.352044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.352275 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.352225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.351999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.352505 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.352682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.352730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353337 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.353206 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.353340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.353644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.353441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.354450 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.354424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.354638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.354621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.354927 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.354881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.355174 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.355158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.355292 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.355277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.355770 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.355750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.363966 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.363934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bkg\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-kube-api-access-k4bkg\") pod \"prometheus-k8s-0\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.552927 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.552652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:36:50.809328 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:50.809244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:36:50.815850 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:50.815814 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28a4d31_b975_4797_96c5_08a1c0f6cdb5.slice/crio-a3edd77d3775a70600681f0f607080dedaa3c3ab359d7eccb7f4721581cf2f76 WatchSource:0}: Error finding container a3edd77d3775a70600681f0f607080dedaa3c3ab359d7eccb7f4721581cf2f76: Status 404 returned error can't find the container with id a3edd77d3775a70600681f0f607080dedaa3c3ab359d7eccb7f4721581cf2f76 Jul 06 20:36:51.269318 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.267093 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" exitCode=0 Jul 06 20:36:51.269318 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.267215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} Jul 06 20:36:51.269318 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.267284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"a3edd77d3775a70600681f0f607080dedaa3c3ab359d7eccb7f4721581cf2f76"} Jul 06 20:36:51.274142 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.273974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"287a973c84e31dfe940dd336f8992833c175156afc674f0676764f89fb36363e"} Jul 06 20:36:51.274142 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.274059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"bddc313df75ce4fb7a7876ef52f826549528ede9fc768e5690e94f781a1119d1"} Jul 06 20:36:51.274142 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.274100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"419a1e272cebe55ceaa19c14a72dbd9ffadca0ef9ec9fab80671d594683bf52f"} Jul 06 20:36:51.274363 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.274145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"c37744b3907dfc1a61d01b1691795f9773fb78ccc285dcbb75d303b9dda9e848"} Jul 06 20:36:51.274363 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.274194 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"6c6b9578a5eb2c16fc180d60a11251f7ef7f51549ced5dbbbbee587fdc7a7457"} Jul 06 20:36:51.274363 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.274229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerStarted","Data":"618f0af0c4c31c7ca9d868d09e4c5f868569064667cf01c3ac8c6675eed33b52"} Jul 06 20:36:51.276918 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.276895 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" event={"ID":"30fd034e-4916-40e1-843c-89bf1f1406a6","Type":"ContainerStarted","Data":"a16698ee1a3dfda1bc86ea446494d774cbf185dbbc207afd29b7f3173eee045d"} Jul 06 20:36:51.333267 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.331537 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" podStartSLOduration=1.7516141269999999 podStartE2EDuration="3.331495365s" totalImagesPullingTime="1.579881238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:51.331280507 +0000 UTC m=+128.155584759" watchObservedRunningTime="2026-07-06 20:36:51.331495365 +0000 UTC m=+128.155799616" Jul 06 20:36:51.365791 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:51.365715 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.815355439 podStartE2EDuration="7.365694627s" totalImagesPullingTime="3.532161248s" totalInitContainerRuntime="18.17794ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:51.36419357 +0000 UTC m=+128.188497826" watchObservedRunningTime="2026-07-06 20:36:51.365694627 +0000 UTC m=+128.189998879" Jul 06 20:36:52.071421 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.071381 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98744456f-h9rxr"] Jul 06 20:36:52.107000 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.106959 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f89b458df-6bggx"] Jul 06 20:36:52.110349 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.110325 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.120774 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.120749 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f89b458df-6bggx"] Jul 06 20:36:52.180609 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-oauth-serving-cert\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.180769 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-serving-cert\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.180769 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxf7\" (UniqueName: \"kubernetes.io/projected/69912ab0-2291-42b1-8091-685c8692487c-kube-api-access-wdxf7\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.180862 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-oauth-config\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.180862 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-service-ca\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.180862 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-console-config\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.180862 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.180838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-trusted-ca-bundle\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281401 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-serving-cert\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxf7\" (UniqueName: \"kubernetes.io/projected/69912ab0-2291-42b1-8091-685c8692487c-kube-api-access-wdxf7\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-oauth-config\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-service-ca\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-console-config\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-trusted-ca-bundle\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.281887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.281637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-oauth-serving-cert\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.282490 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.282406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-oauth-serving-cert\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.282743 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.282713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-console-config\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.282855 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.282723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-service-ca\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.283065 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.283044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-trusted-ca-bundle\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.284212 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.284179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" event={"ID":"37747521-9d09-4073-a3c7-0a84e32a6410","Type":"ContainerStarted","Data":"eb9ebf1e40c1010b71ea1ec9ad6b5bb47409d175b52f72aba4164c6c0e5f0a33"} Jul 06 20:36:52.284315 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.284246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" event={"ID":"37747521-9d09-4073-a3c7-0a84e32a6410","Type":"ContainerStarted","Data":"9246958d6d1e3e9b2a31f782a7891baca325f861b2a7082183deded9173c138d"} Jul 06 20:36:52.284315 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.284275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" event={"ID":"37747521-9d09-4073-a3c7-0a84e32a6410","Type":"ContainerStarted","Data":"9a5a91f1d99253799292f8b1f7714b81e5aa9c9f956e97a06c32b9cacd5aee41"} Jul 06 20:36:52.284923 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.284898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-oauth-config\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.285356 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.285335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-serving-cert\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.293544 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.293492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxf7\" (UniqueName: \"kubernetes.io/projected/69912ab0-2291-42b1-8091-685c8692487c-kube-api-access-wdxf7\") pod \"console-6f89b458df-6bggx\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.311013 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.310956 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56b95fbb4c-qpmxk" podStartSLOduration=1.447035444 podStartE2EDuration="3.310938146s" totalImagesPullingTime="1.863902702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:52.308945068 +0000 UTC m=+129.133249322" watchObservedRunningTime="2026-07-06 20:36:52.310938146 +0000 UTC m=+129.135242404" Jul 06 20:36:52.419861 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.419766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:36:52.582892 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:52.582861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f89b458df-6bggx"] Jul 06 20:36:52.585467 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:52.585431 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69912ab0_2291_42b1_8091_685c8692487c.slice/crio-f690214b7867ea1822332786dc9c230bd61aea4b0601256019fe8b1f93af09d4 WatchSource:0}: Error finding container f690214b7867ea1822332786dc9c230bd61aea4b0601256019fe8b1f93af09d4: Status 404 returned error can't find the container with id f690214b7867ea1822332786dc9c230bd61aea4b0601256019fe8b1f93af09d4 Jul 06 20:36:53.232205 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.232168 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687ffffbb6-827b6"] Jul 06 20:36:53.290200 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.290163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f89b458df-6bggx" event={"ID":"69912ab0-2291-42b1-8091-685c8692487c","Type":"ContainerStarted","Data":"44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215"} Jul 06 20:36:53.290661 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.290223 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f89b458df-6bggx" event={"ID":"69912ab0-2291-42b1-8091-685c8692487c","Type":"ContainerStarted","Data":"f690214b7867ea1822332786dc9c230bd61aea4b0601256019fe8b1f93af09d4"} Jul 06 20:36:53.316427 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.316363 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f89b458df-6bggx" podStartSLOduration=1.316341657 podStartE2EDuration="1.316341657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:53.314624284 +0000 UTC m=+130.138928536" watchObservedRunningTime="2026-07-06 20:36:53.316341657 +0000 UTC m=+130.140645913" Jul 06 20:36:53.394681 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.394645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:36:53.400190 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.400131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c1e87e-16f0-47a9-8c84-3ef8a5e889c0-metrics-certs\") pod \"network-metrics-daemon-qhwm8\" (UID: \"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0\") " pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:36:53.560364 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.560228 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gll5g\"" Jul 06 20:36:53.567502 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.567469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhwm8" Jul 06 20:36:53.754024 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.753991 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhwm8"] Jul 06 20:36:53.756388 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:53.756355 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c1e87e_16f0_47a9_8c84_3ef8a5e889c0.slice/crio-2dd030bbbb9558502511884be43aac766d3db9fdd2ecbeaa464698e712a0d51d WatchSource:0}: Error finding container 2dd030bbbb9558502511884be43aac766d3db9fdd2ecbeaa464698e712a0d51d: Status 404 returned error can't find the container with id 2dd030bbbb9558502511884be43aac766d3db9fdd2ecbeaa464698e712a0d51d Jul 06 20:36:53.761611 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:53.761588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:36:54.297273 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:54.297237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhwm8" event={"ID":"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0","Type":"ContainerStarted","Data":"2dd030bbbb9558502511884be43aac766d3db9fdd2ecbeaa464698e712a0d51d"} Jul 06 20:36:55.308438 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:55.308401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} Jul 06 20:36:55.308857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:55.308563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} Jul 06 20:36:55.308857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:55.308611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} Jul 06 20:36:56.316867 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.316820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} Jul 06 20:36:56.317289 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.316890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} Jul 06 20:36:56.317289 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.316930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerStarted","Data":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} Jul 06 20:36:56.318757 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.318723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhwm8" event={"ID":"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0","Type":"ContainerStarted","Data":"5ba54d23b95bbefc1d2c3f580de13d671cd0f2353c6a1ef8278acf2732f646a5"} Jul 06 20:36:56.318857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.318785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhwm8" event={"ID":"02c1e87e-16f0-47a9-8c84-3ef8a5e889c0","Type":"ContainerStarted","Data":"f0bfdc2b430f411ddb99a8ce387be925737ac59e25bd0a6358ddc3f5ebcae7ff"} Jul 06 20:36:56.355046 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.354991 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.634907794 podStartE2EDuration="6.354973192s" totalImagesPullingTime="3.70087565s" totalInitContainerRuntime="19.189748ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:56.351889658 +0000 UTC m=+133.176193924" watchObservedRunningTime="2026-07-06 20:36:56.354973192 +0000 UTC m=+133.179277443" Jul 06 20:36:56.371142 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:56.371073 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qhwm8" podStartSLOduration=130.163396808 podStartE2EDuration="2m12.371050007s" totalImagesPullingTime="2.207653199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:56.369430371 +0000 UTC m=+133.193734625" watchObservedRunningTime="2026-07-06 20:36:56.371050007 +0000 UTC m=+133.195354260" Jul 06 20:36:57.292187 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:57.292157 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-87c9b7bb7-2z64x" Jul 06 20:36:59.017721 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.017684 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f89b458df-6bggx"] Jul 06 20:36:59.053248 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.053216 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8589b878d5-qtsvr"] Jul 06 20:36:59.057696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.057675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.074591 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.074564 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8589b878d5-qtsvr"] Jul 06 20:36:59.168611 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fpfk\" (UniqueName: \"kubernetes.io/projected/551940f2-ca49-4097-816f-9ff6a4803ca8-kube-api-access-6fpfk\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.168807 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-oauth-config\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.168807 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-console-config\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.168918 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-serving-cert\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.168918 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-trusted-ca-bundle\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.168918 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-oauth-serving-cert\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.169021 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.168946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-service-ca\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.269775 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.269675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-trusted-ca-bundle\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.269775 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.269714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-oauth-serving-cert\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.269775 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.269741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-service-ca\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.269995 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.269947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpfk\" (UniqueName: \"kubernetes.io/projected/551940f2-ca49-4097-816f-9ff6a4803ca8-kube-api-access-6fpfk\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270064 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-oauth-config\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270165 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-console-config\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270165 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-serving-cert\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270611 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-oauth-serving-cert\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270698 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-service-ca\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270698 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-trusted-ca-bundle\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.270855 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.270757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-console-config\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.272579 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.272559 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-oauth-config\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.272680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.272664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-serving-cert\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.283455 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.283425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fpfk\" (UniqueName: \"kubernetes.io/projected/551940f2-ca49-4097-816f-9ff6a4803ca8-kube-api-access-6fpfk\") pod \"console-8589b878d5-qtsvr\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.366619 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.366582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:36:59.509233 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:36:59.509205 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8589b878d5-qtsvr"] Jul 06 20:36:59.511939 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:36:59.511912 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551940f2_ca49_4097_816f_9ff6a4803ca8.slice/crio-6f6373919f6a06e66c4ccae5d24a682a0b203f88f81b7cddffd626c7394bd99d WatchSource:0}: Error finding container 6f6373919f6a06e66c4ccae5d24a682a0b203f88f81b7cddffd626c7394bd99d: Status 404 returned error can't find the container with id 6f6373919f6a06e66c4ccae5d24a682a0b203f88f81b7cddffd626c7394bd99d Jul 06 20:37:00.337445 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:00.337408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8589b878d5-qtsvr" event={"ID":"551940f2-ca49-4097-816f-9ff6a4803ca8","Type":"ContainerStarted","Data":"7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37"} Jul 06 20:37:00.337923 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:00.337485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8589b878d5-qtsvr" event={"ID":"551940f2-ca49-4097-816f-9ff6a4803ca8","Type":"ContainerStarted","Data":"6f6373919f6a06e66c4ccae5d24a682a0b203f88f81b7cddffd626c7394bd99d"} Jul 06 20:37:00.553276 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:00.553226 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:37:02.419931 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:02.419896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:37:04.171125 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:04.171090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sjhf_59edef18-394d-4f0f-a538-916ec76d5482/serve-healthcheck-canary/0.log" Jul 06 20:37:08.653346 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:08.653311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:37:08.653751 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:08.653368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:37:09.366768 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:09.366728 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:37:09.366981 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:09.366816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:37:09.371672 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:09.371643 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:37:09.380009 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:09.379983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:37:09.399510 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:09.399461 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8589b878d5-qtsvr" podStartSLOduration=10.399443986 podStartE2EDuration="10.399443986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:00.36581624 +0000 UTC m=+137.190120492" watchObservedRunningTime="2026-07-06 20:37:09.399443986 +0000 UTC m=+146.223748237" Jul 06 20:37:09.461225 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:09.461192 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd94d67c8-m2h2d"] Jul 06 20:37:17.094814 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.094742 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-98744456f-h9rxr" podUID="49eb654c-f5f0-4b57-93aa-03eda8ade241" containerName="console" containerID="cri-o://572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0" gracePeriod=15 Jul 06 20:37:17.373997 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.373962 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:37:17.423806 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.423750 2578 generic.go:356] "Generic (PLEG): container finished" podID="49eb654c-f5f0-4b57-93aa-03eda8ade241" containerID="572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0" exitCode=0 Jul 06 20:37:17.424004 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.423827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98744456f-h9rxr" event={"ID":"49eb654c-f5f0-4b57-93aa-03eda8ade241","Type":"ContainerDied","Data":"572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0"} Jul 06 20:37:17.424004 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.423868 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98744456f-h9rxr" Jul 06 20:37:17.424004 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.423878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98744456f-h9rxr" event={"ID":"49eb654c-f5f0-4b57-93aa-03eda8ade241","Type":"ContainerDied","Data":"6891da0ee7a8be7f765f3ee4c695879f283e16c4c09f8e758e6f02853c428886"} Jul 06 20:37:17.424004 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.423902 2578 scope.go:117] "RemoveContainer" containerID="572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0" Jul 06 20:37:17.436116 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.436084 2578 scope.go:117] "RemoveContainer" containerID="572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0" Jul 06 20:37:17.436776 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:37:17.436532 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0\": container with ID starting with 572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0 not found: ID does not exist" containerID="572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0" Jul 06 20:37:17.436776 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.436577 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0"} err="failed to get container status \"572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0\": rpc error: code = NotFound desc = could not find container \"572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0\": container with ID starting with 572d4447ab9d48164ea38600441d0831afe5e2e418341e2a9d0b48d7a482a4a0 not found: ID does not exist" Jul 06 20:37:17.443432 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443402 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-service-ca\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.443616 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443462 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-serving-cert\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.443616 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443539 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-trusted-ca-bundle\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.443616 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443566 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtcvj\" (UniqueName: \"kubernetes.io/projected/49eb654c-f5f0-4b57-93aa-03eda8ade241-kube-api-access-gtcvj\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.443781 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443639 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-oauth-serving-cert\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.443781 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443752 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-oauth-config\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.443883 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.443817 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-service-ca" (OuterVolumeSpecName: "service-ca") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:17.444091 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.444066 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-service-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.444469 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.444435 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:17.444469 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.444457 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:17.446651 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.446623 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:17.446879 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.446844 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:17.447175 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.447153 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49eb654c-f5f0-4b57-93aa-03eda8ade241-kube-api-access-gtcvj" (OuterVolumeSpecName: "kube-api-access-gtcvj") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "kube-api-access-gtcvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:17.545164 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545113 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-config\") pod \"49eb654c-f5f0-4b57-93aa-03eda8ade241\" (UID: \"49eb654c-f5f0-4b57-93aa-03eda8ade241\") " Jul 06 20:37:17.545638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545511 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.545638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545590 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-trusted-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.545638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545603 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtcvj\" (UniqueName: \"kubernetes.io/projected/49eb654c-f5f0-4b57-93aa-03eda8ade241-kube-api-access-gtcvj\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.545638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545615 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-oauth-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.545638 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545627 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-oauth-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.546022 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.545959 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-config" (OuterVolumeSpecName: "console-config") pod "49eb654c-f5f0-4b57-93aa-03eda8ade241" (UID: "49eb654c-f5f0-4b57-93aa-03eda8ade241"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:17.646946 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.646855 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49eb654c-f5f0-4b57-93aa-03eda8ade241-console-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:17.743777 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.743738 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98744456f-h9rxr"] Jul 06 20:37:17.748964 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:17.748934 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98744456f-h9rxr"] Jul 06 20:37:18.257703 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.257648 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" podUID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" containerName="registry" containerID="cri-o://75efa1f6b7fbe2fde377898da3bc0c3d5a456ca0d995f01050e6445cc4d92895" gracePeriod=30 Jul 06 20:37:18.431758 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.431726 2578 generic.go:356] "Generic (PLEG): container finished" podID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" containerID="75efa1f6b7fbe2fde377898da3bc0c3d5a456ca0d995f01050e6445cc4d92895" exitCode=0 Jul 06 20:37:18.431898 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.431797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" event={"ID":"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88","Type":"ContainerDied","Data":"75efa1f6b7fbe2fde377898da3bc0c3d5a456ca0d995f01050e6445cc4d92895"} Jul 06 20:37:18.511242 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.511177 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:37:18.555014 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.554979 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-ca-trust-extracted\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555065 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-bound-sa-token\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555107 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555294 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555269 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-image-registry-private-configuration\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555330 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-installation-pull-secrets\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555424 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555400 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2flt\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-kube-api-access-t2flt\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555429 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-certificates\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.555482 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.555481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-trusted-ca\") pod \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\" (UID: \"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88\") " Jul 06 20:37:18.556470 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.556439 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:18.556727 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.556682 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:18.558149 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.558126 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-kube-api-access-t2flt" (OuterVolumeSpecName: "kube-api-access-t2flt") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "kube-api-access-t2flt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:18.558410 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.558387 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:18.558853 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.558833 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:18.558962 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.558938 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:18.560074 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.560052 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:18.566141 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.566114 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" (UID: "d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:37:18.656772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656728 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-image-registry-private-configuration\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.656772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656768 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-installation-pull-secrets\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.656772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656778 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2flt\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-kube-api-access-t2flt\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.656772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656787 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-certificates\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.656772 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656797 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-trusted-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.657167 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656806 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-ca-trust-extracted\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.657167 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656814 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-bound-sa-token\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:18.657167 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:18.656821 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88-registry-tls\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.439378 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.439342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" event={"ID":"d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88","Type":"ContainerDied","Data":"f0760047d31f49d167ee68a561cbff059ef514c7ea2582c03a8496fefce6b1df"} Jul 06 20:37:19.439378 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.439377 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687ffffbb6-827b6" Jul 06 20:37:19.439837 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.439403 2578 scope.go:117] "RemoveContainer" containerID="75efa1f6b7fbe2fde377898da3bc0c3d5a456ca0d995f01050e6445cc4d92895" Jul 06 20:37:19.462103 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.462072 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687ffffbb6-827b6"] Jul 06 20:37:19.466960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.466931 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-687ffffbb6-827b6"] Jul 06 20:37:19.652267 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.652233 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49eb654c-f5f0-4b57-93aa-03eda8ade241" path="/var/lib/kubelet/pods/49eb654c-f5f0-4b57-93aa-03eda8ade241/volumes" Jul 06 20:37:19.652660 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:19.652647 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" path="/var/lib/kubelet/pods/d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88/volumes" Jul 06 20:37:24.037721 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.037661 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f89b458df-6bggx" podUID="69912ab0-2291-42b1-8091-685c8692487c" containerName="console" containerID="cri-o://44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215" gracePeriod=15 Jul 06 20:37:24.308238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.308165 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:37:24.406913 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.406874 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdxf7\" (UniqueName: \"kubernetes.io/projected/69912ab0-2291-42b1-8091-685c8692487c-kube-api-access-wdxf7\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.406913 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.406914 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-trusted-ca-bundle\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.407161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.406993 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-serving-cert\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.407161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-console-config\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.407161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407042 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-service-ca\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.407161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407114 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-oauth-serving-cert\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.407334 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407164 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-oauth-config\") pod \"69912ab0-2291-42b1-8091-685c8692487c\" (UID: \"69912ab0-2291-42b1-8091-685c8692487c\") " Jul 06 20:37:24.407476 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407446 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:24.407766 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407731 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:24.407886 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407767 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-trusted-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:24.407942 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407918 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-console-config" (OuterVolumeSpecName: "console-config") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:24.408003 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.407971 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-service-ca" (OuterVolumeSpecName: "service-ca") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:24.409280 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.409252 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69912ab0-2291-42b1-8091-685c8692487c-kube-api-access-wdxf7" (OuterVolumeSpecName: "kube-api-access-wdxf7") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "kube-api-access-wdxf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:24.409515 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.409492 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:24.409802 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.409782 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69912ab0-2291-42b1-8091-685c8692487c" (UID: "69912ab0-2291-42b1-8091-685c8692487c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:24.469701 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.469661 2578 generic.go:356] "Generic (PLEG): container finished" podID="69912ab0-2291-42b1-8091-685c8692487c" containerID="44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215" exitCode=0 Jul 06 20:37:24.469836 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.469717 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f89b458df-6bggx" Jul 06 20:37:24.469836 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.469752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f89b458df-6bggx" event={"ID":"69912ab0-2291-42b1-8091-685c8692487c","Type":"ContainerDied","Data":"44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215"} Jul 06 20:37:24.469836 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.469808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f89b458df-6bggx" event={"ID":"69912ab0-2291-42b1-8091-685c8692487c","Type":"ContainerDied","Data":"f690214b7867ea1822332786dc9c230bd61aea4b0601256019fe8b1f93af09d4"} Jul 06 20:37:24.469836 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.469828 2578 scope.go:117] "RemoveContainer" containerID="44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215" Jul 06 20:37:24.478444 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.478429 2578 scope.go:117] "RemoveContainer" containerID="44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215" Jul 06 20:37:24.478701 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:37:24.478684 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215\": container with ID starting with 44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215 not found: ID does not exist" containerID="44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215" Jul 06 20:37:24.478768 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.478708 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215"} err="failed to get container status \"44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215\": rpc error: code = NotFound desc = could not find container \"44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215\": container with ID starting with 44371f8abbdcfc07cba545fab53a4cb0ba39b474fc9ef7d456acb67c64483215 not found: ID does not exist" Jul 06 20:37:24.496243 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.496219 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f89b458df-6bggx"] Jul 06 20:37:24.501926 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.501903 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f89b458df-6bggx"] Jul 06 20:37:24.508639 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.508616 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-oauth-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:24.508734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.508641 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-oauth-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:24.508734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.508652 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdxf7\" (UniqueName: \"kubernetes.io/projected/69912ab0-2291-42b1-8091-685c8692487c-kube-api-access-wdxf7\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:24.508734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.508660 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69912ab0-2291-42b1-8091-685c8692487c-console-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:24.508734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.508668 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-console-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:24.508734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:24.508676 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69912ab0-2291-42b1-8091-685c8692487c-service-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:25.652133 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:25.652100 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69912ab0-2291-42b1-8091-685c8692487c" path="/var/lib/kubelet/pods/69912ab0-2291-42b1-8091-685c8692487c/volumes" Jul 06 20:37:28.658108 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:28.658075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:37:28.661853 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:28.661830 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-555944bbd6-wjn7j" Jul 06 20:37:34.490147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.490104 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dd94d67c8-m2h2d" podUID="79461e61-ffb8-4bb9-81ff-738fff27c535" containerName="console" containerID="cri-o://8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e" gracePeriod=15 Jul 06 20:37:34.737066 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.737042 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:37:34.805705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.805674 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-oauth-serving-cert\") pod \"79461e61-ffb8-4bb9-81ff-738fff27c535\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " Jul 06 20:37:34.805902 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.805721 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-oauth-config\") pod \"79461e61-ffb8-4bb9-81ff-738fff27c535\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " Jul 06 20:37:34.805902 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.805855 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9xvl\" (UniqueName: \"kubernetes.io/projected/79461e61-ffb8-4bb9-81ff-738fff27c535-kube-api-access-g9xvl\") pod \"79461e61-ffb8-4bb9-81ff-738fff27c535\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " Jul 06 20:37:34.806024 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.805921 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-serving-cert\") pod \"79461e61-ffb8-4bb9-81ff-738fff27c535\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " Jul 06 20:37:34.806024 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.805940 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-console-config\") pod \"79461e61-ffb8-4bb9-81ff-738fff27c535\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " Jul 06 20:37:34.806024 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.805969 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-service-ca\") pod \"79461e61-ffb8-4bb9-81ff-738fff27c535\" (UID: \"79461e61-ffb8-4bb9-81ff-738fff27c535\") " Jul 06 20:37:34.806169 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.806136 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79461e61-ffb8-4bb9-81ff-738fff27c535" (UID: "79461e61-ffb8-4bb9-81ff-738fff27c535"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:34.806362 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.806335 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-console-config" (OuterVolumeSpecName: "console-config") pod "79461e61-ffb8-4bb9-81ff-738fff27c535" (UID: "79461e61-ffb8-4bb9-81ff-738fff27c535"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:34.806362 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.806350 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-oauth-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:34.806732 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.806434 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-service-ca" (OuterVolumeSpecName: "service-ca") pod "79461e61-ffb8-4bb9-81ff-738fff27c535" (UID: "79461e61-ffb8-4bb9-81ff-738fff27c535"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:34.807950 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.807928 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79461e61-ffb8-4bb9-81ff-738fff27c535" (UID: "79461e61-ffb8-4bb9-81ff-738fff27c535"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:34.808448 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.808417 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79461e61-ffb8-4bb9-81ff-738fff27c535" (UID: "79461e61-ffb8-4bb9-81ff-738fff27c535"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:34.808448 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.808428 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79461e61-ffb8-4bb9-81ff-738fff27c535-kube-api-access-g9xvl" (OuterVolumeSpecName: "kube-api-access-g9xvl") pod "79461e61-ffb8-4bb9-81ff-738fff27c535" (UID: "79461e61-ffb8-4bb9-81ff-738fff27c535"). InnerVolumeSpecName "kube-api-access-g9xvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:34.907238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.907187 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:34.907238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.907230 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-console-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:34.907238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.907241 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79461e61-ffb8-4bb9-81ff-738fff27c535-service-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:34.907238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.907250 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79461e61-ffb8-4bb9-81ff-738fff27c535-console-oauth-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:34.907238 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:34.907259 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9xvl\" (UniqueName: \"kubernetes.io/projected/79461e61-ffb8-4bb9-81ff-738fff27c535-kube-api-access-g9xvl\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:37:35.516903 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.516869 2578 generic.go:356] "Generic (PLEG): container finished" podID="79461e61-ffb8-4bb9-81ff-738fff27c535" containerID="8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e" exitCode=0 Jul 06 20:37:35.517320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.516911 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd94d67c8-m2h2d" Jul 06 20:37:35.517320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.516954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd94d67c8-m2h2d" event={"ID":"79461e61-ffb8-4bb9-81ff-738fff27c535","Type":"ContainerDied","Data":"8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e"} Jul 06 20:37:35.517320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.517031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd94d67c8-m2h2d" event={"ID":"79461e61-ffb8-4bb9-81ff-738fff27c535","Type":"ContainerDied","Data":"6abed6dc867795678b75b2e71bb3f56d7b42575b3b4200badbd51c6846250a37"} Jul 06 20:37:35.517320 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.517052 2578 scope.go:117] "RemoveContainer" containerID="8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e" Jul 06 20:37:35.526332 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.526315 2578 scope.go:117] "RemoveContainer" containerID="8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e" Jul 06 20:37:35.526627 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:37:35.526610 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e\": container with ID starting with 8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e not found: ID does not exist" containerID="8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e" Jul 06 20:37:35.526699 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.526635 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e"} err="failed to get container status \"8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e\": rpc error: code = NotFound desc = could not find container \"8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e\": container with ID starting with 8a2babd3a58a23016c762404acb1a65d41bccc4b5081c85016acdbf706dceb3e not found: ID does not exist" Jul 06 20:37:35.541093 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.541066 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd94d67c8-m2h2d"] Jul 06 20:37:35.550859 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.550835 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd94d67c8-m2h2d"] Jul 06 20:37:35.651530 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:35.651484 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79461e61-ffb8-4bb9-81ff-738fff27c535" path="/var/lib/kubelet/pods/79461e61-ffb8-4bb9-81ff-738fff27c535/volumes" Jul 06 20:37:50.553682 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:50.553641 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:37:50.573901 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:50.573868 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:37:50.600980 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:37:50.600952 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:00.237849 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.237815 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fbb6765-ljphg"] Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238183 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79461e61-ffb8-4bb9-81ff-738fff27c535" containerName="console" Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238196 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="79461e61-ffb8-4bb9-81ff-738fff27c535" containerName="console" Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238214 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49eb654c-f5f0-4b57-93aa-03eda8ade241" containerName="console" Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238220 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49eb654c-f5f0-4b57-93aa-03eda8ade241" containerName="console" Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238228 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69912ab0-2291-42b1-8091-685c8692487c" containerName="console" Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238234 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69912ab0-2291-42b1-8091-685c8692487c" containerName="console" Jul 06 20:38:00.238250 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238249 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" containerName="registry" Jul 06 20:38:00.238449 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238258 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" containerName="registry" Jul 06 20:38:00.238449 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238312 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c68a87-0c25-4bf6-ad20-a7c6a9cafb88" containerName="registry" Jul 06 20:38:00.238449 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238320 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="79461e61-ffb8-4bb9-81ff-738fff27c535" containerName="console" Jul 06 20:38:00.238449 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238326 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49eb654c-f5f0-4b57-93aa-03eda8ade241" containerName="console" Jul 06 20:38:00.238449 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.238336 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="69912ab0-2291-42b1-8091-685c8692487c" containerName="console" Jul 06 20:38:00.242177 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.242153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.255091 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.255052 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fbb6765-ljphg"] Jul 06 20:38:00.334043 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.333999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-trusted-ca-bundle\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.334240 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.334070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-serving-cert\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.334240 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.334108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-config\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.334240 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.334131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swt2\" (UniqueName: \"kubernetes.io/projected/3006a63c-54b2-440b-b162-5aa3653bfbe9-kube-api-access-9swt2\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.334240 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.334153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-service-ca\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.334240 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.334182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-oauth-serving-cert\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.334240 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.334224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-oauth-config\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.434924 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.434888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-serving-cert\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.434924 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.434933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-config\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435156 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swt2\" (UniqueName: \"kubernetes.io/projected/3006a63c-54b2-440b-b162-5aa3653bfbe9-kube-api-access-9swt2\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435156 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-service-ca\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435156 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-oauth-serving-cert\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435341 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-oauth-config\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435477 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-trusted-ca-bundle\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435707 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-config\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435832 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-service-ca\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.435933 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.435809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-oauth-serving-cert\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.436175 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.436154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-trusted-ca-bundle\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.437673 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.437655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-serving-cert\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.437767 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.437750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-oauth-config\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.444904 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.444883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swt2\" (UniqueName: \"kubernetes.io/projected/3006a63c-54b2-440b-b162-5aa3653bfbe9-kube-api-access-9swt2\") pod \"console-85fbb6765-ljphg\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.551739 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.551696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:00.688875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:00.688831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fbb6765-ljphg"] Jul 06 20:38:00.691707 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:38:00.691674 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3006a63c_54b2_440b_b162_5aa3653bfbe9.slice/crio-23672590ea4f61afc751ce6398dbdb3a44776526ad9e668e7d2c296c967f7022 WatchSource:0}: Error finding container 23672590ea4f61afc751ce6398dbdb3a44776526ad9e668e7d2c296c967f7022: Status 404 returned error can't find the container with id 23672590ea4f61afc751ce6398dbdb3a44776526ad9e668e7d2c296c967f7022 Jul 06 20:38:01.637046 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:01.637000 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbb6765-ljphg" event={"ID":"3006a63c-54b2-440b-b162-5aa3653bfbe9","Type":"ContainerStarted","Data":"b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905"} Jul 06 20:38:01.637432 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:01.637062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbb6765-ljphg" event={"ID":"3006a63c-54b2-440b-b162-5aa3653bfbe9","Type":"ContainerStarted","Data":"23672590ea4f61afc751ce6398dbdb3a44776526ad9e668e7d2c296c967f7022"} Jul 06 20:38:01.658800 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:01.658749 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85fbb6765-ljphg" podStartSLOduration=1.65873245 podStartE2EDuration="1.65873245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:01.657364081 +0000 UTC m=+198.481668333" watchObservedRunningTime="2026-07-06 20:38:01.65873245 +0000 UTC m=+198.483036755" Jul 06 20:38:04.416735 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.416694 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:04.417115 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.416997 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="alertmanager" containerID="cri-o://618f0af0c4c31c7ca9d868d09e4c5f868569064667cf01c3ac8c6675eed33b52" gracePeriod=120 Jul 06 20:38:04.417201 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.417078 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-metric" containerID="cri-o://bddc313df75ce4fb7a7876ef52f826549528ede9fc768e5690e94f781a1119d1" gracePeriod=120 Jul 06 20:38:04.417201 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.417129 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-web" containerID="cri-o://c37744b3907dfc1a61d01b1691795f9773fb78ccc285dcbb75d303b9dda9e848" gracePeriod=120 Jul 06 20:38:04.417201 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.417170 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="prom-label-proxy" containerID="cri-o://287a973c84e31dfe940dd336f8992833c175156afc674f0676764f89fb36363e" gracePeriod=120 Jul 06 20:38:04.417201 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.417152 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="config-reloader" containerID="cri-o://6c6b9578a5eb2c16fc180d60a11251f7ef7f51549ced5dbbbbee587fdc7a7457" gracePeriod=120 Jul 06 20:38:04.417387 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.417214 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy" containerID="cri-o://419a1e272cebe55ceaa19c14a72dbd9ffadca0ef9ec9fab80671d594683bf52f" gracePeriod=120 Jul 06 20:38:04.652114 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652080 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="287a973c84e31dfe940dd336f8992833c175156afc674f0676764f89fb36363e" exitCode=0 Jul 06 20:38:04.652114 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652107 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="419a1e272cebe55ceaa19c14a72dbd9ffadca0ef9ec9fab80671d594683bf52f" exitCode=0 Jul 06 20:38:04.652114 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652115 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="6c6b9578a5eb2c16fc180d60a11251f7ef7f51549ced5dbbbbee587fdc7a7457" exitCode=0 Jul 06 20:38:04.652114 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652123 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="618f0af0c4c31c7ca9d868d09e4c5f868569064667cf01c3ac8c6675eed33b52" exitCode=0 Jul 06 20:38:04.652379 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"287a973c84e31dfe940dd336f8992833c175156afc674f0676764f89fb36363e"} Jul 06 20:38:04.652379 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"419a1e272cebe55ceaa19c14a72dbd9ffadca0ef9ec9fab80671d594683bf52f"} Jul 06 20:38:04.652379 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"6c6b9578a5eb2c16fc180d60a11251f7ef7f51549ced5dbbbbee587fdc7a7457"} Jul 06 20:38:04.652379 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:04.652261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"618f0af0c4c31c7ca9d868d09e4c5f868569064667cf01c3ac8c6675eed33b52"} Jul 06 20:38:05.659197 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.659162 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="bddc313df75ce4fb7a7876ef52f826549528ede9fc768e5690e94f781a1119d1" exitCode=0 Jul 06 20:38:05.659197 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.659193 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c616a13-acea-496d-b696-1c15969eff50" containerID="c37744b3907dfc1a61d01b1691795f9773fb78ccc285dcbb75d303b9dda9e848" exitCode=0 Jul 06 20:38:05.659636 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.659228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"bddc313df75ce4fb7a7876ef52f826549528ede9fc768e5690e94f781a1119d1"} Jul 06 20:38:05.659636 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.659296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"c37744b3907dfc1a61d01b1691795f9773fb78ccc285dcbb75d303b9dda9e848"} Jul 06 20:38:05.659636 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.659326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c616a13-acea-496d-b696-1c15969eff50","Type":"ContainerDied","Data":"671ea82e59c5fbe6a17543c194c35b32dc5398fd8c568862ad8c930101282320"} Jul 06 20:38:05.659636 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.659354 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="671ea82e59c5fbe6a17543c194c35b32dc5398fd8c568862ad8c930101282320" Jul 06 20:38:05.665210 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.665186 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:05.679246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679212 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679246 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679250 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-main-db\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679463 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679377 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-web-config\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679463 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679405 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-config-out\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679463 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679438 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679632 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679567 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-web\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679631 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679641 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:38:05.679689 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679698 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-cluster-tls-config\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679745 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-tls-assets\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679785 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjwhj\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-kube-api-access-xjwhj\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.679850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679825 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-metrics-client-ca\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.680216 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.679883 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-config-volume\") pod \"4c616a13-acea-496d-b696-1c15969eff50\" (UID: \"4c616a13-acea-496d-b696-1c15969eff50\") " Jul 06 20:38:05.680216 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.680148 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:05.680371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.680247 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-main-db\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.680371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.680265 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.680888 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.680862 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:05.682857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.682809 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-config-out" (OuterVolumeSpecName: "config-out") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:38:05.682965 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.682895 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.683302 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.683275 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.683551 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.683496 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.683878 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.683851 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:38:05.684136 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.684110 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.684136 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.684123 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-kube-api-access-xjwhj" (OuterVolumeSpecName: "kube-api-access-xjwhj") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "kube-api-access-xjwhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:38:05.684262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.684148 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-config-volume" (OuterVolumeSpecName: "config-volume") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.687719 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.687693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.694980 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.694952 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-web-config" (OuterVolumeSpecName: "web-config") pod "4c616a13-acea-496d-b696-1c15969eff50" (UID: "4c616a13-acea-496d-b696-1c15969eff50"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780875 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780908 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-main-tls\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780925 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-cluster-tls-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780936 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-tls-assets\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780947 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjwhj\" (UniqueName: \"kubernetes.io/projected/4c616a13-acea-496d-b696-1c15969eff50-kube-api-access-xjwhj\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780958 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c616a13-acea-496d-b696-1c15969eff50-metrics-client-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.780969 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780969 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-config-volume\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.781295 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780982 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.781295 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.780993 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-web-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.781295 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.781004 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c616a13-acea-496d-b696-1c15969eff50-config-out\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:05.781295 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:05.781014 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c616a13-acea-496d-b696-1c15969eff50-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:06.662971 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.662939 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.689338 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.689305 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:06.695988 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.695939 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:06.730809 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.730780 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:06.731131 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731108 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="alertmanager" Jul 06 20:38:06.731131 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731124 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="alertmanager" Jul 06 20:38:06.731131 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731134 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-web" Jul 06 20:38:06.731131 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731139 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-web" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731154 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731159 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731166 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="prom-label-proxy" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731171 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="prom-label-proxy" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731180 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="init-config-reloader" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731184 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="init-config-reloader" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731194 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="config-reloader" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731199 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="config-reloader" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731205 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-metric" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731209 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-metric" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731267 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731276 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-web" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731282 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="alertmanager" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731287 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="config-reloader" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731293 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="kube-rbac-proxy-metric" Jul 06 20:38:06.731327 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.731300 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c616a13-acea-496d-b696-1c15969eff50" containerName="prom-label-proxy" Jul 06 20:38:06.736104 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.736087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.739078 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:38:06.739078 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739070 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:38:06.739263 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739116 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p9k57\"" Jul 06 20:38:06.739495 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739481 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:38:06.739694 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:38:06.739744 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739703 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:38:06.739789 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:38:06.739826 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.739679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:38:06.740226 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.740209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:38:06.746455 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.746436 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:38:06.750960 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.750939 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:06.790155 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmtb\" (UniqueName: \"kubernetes.io/projected/6e9d2898-542b-445c-8a79-c524e3dd06ff-kube-api-access-szmtb\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790155 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790155 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790430 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790430 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e9d2898-542b-445c-8a79-c524e3dd06ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790430 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e9d2898-542b-445c-8a79-c524e3dd06ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790430 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790430 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-web-config\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790430 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9d2898-542b-445c-8a79-c524e3dd06ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e9d2898-542b-445c-8a79-c524e3dd06ff-config-out\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.790705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.790583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e9d2898-542b-445c-8a79-c524e3dd06ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891572 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e9d2898-542b-445c-8a79-c524e3dd06ff-config-out\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891743 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891743 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891743 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e9d2898-542b-445c-8a79-c524e3dd06ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891743 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szmtb\" (UniqueName: \"kubernetes.io/projected/6e9d2898-542b-445c-8a79-c524e3dd06ff-kube-api-access-szmtb\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891935 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891935 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.891935 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892085 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e9d2898-542b-445c-8a79-c524e3dd06ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892085 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.891993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e9d2898-542b-445c-8a79-c524e3dd06ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892085 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.892031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892085 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.892064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-web-config\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892275 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.892089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9d2898-542b-445c-8a79-c524e3dd06ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892515 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.892464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e9d2898-542b-445c-8a79-c524e3dd06ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.892909 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.892883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9d2898-542b-445c-8a79-c524e3dd06ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895187 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.894871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e9d2898-542b-445c-8a79-c524e3dd06ff-config-out\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895187 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.894955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895187 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.894964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895187 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.895161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895451 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.895210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895451 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.895277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e9d2898-542b-445c-8a79-c524e3dd06ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895451 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.895348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895451 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.895380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e9d2898-542b-445c-8a79-c524e3dd06ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.895843 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.895612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.897012 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.896992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e9d2898-542b-445c-8a79-c524e3dd06ff-web-config\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:06.901374 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:06.901356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmtb\" (UniqueName: \"kubernetes.io/projected/6e9d2898-542b-445c-8a79-c524e3dd06ff-kube-api-access-szmtb\") pod \"alertmanager-main-0\" (UID: \"6e9d2898-542b-445c-8a79-c524e3dd06ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:07.046593 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:07.046475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:07.191146 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:07.191115 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:07.192816 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:38:07.192795 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9d2898_542b_445c_8a79_c524e3dd06ff.slice/crio-df1de95a4e0ad727b21c0d9fcfc6c6135806e2bb5aed595438d6d3f20c3f62a9 WatchSource:0}: Error finding container df1de95a4e0ad727b21c0d9fcfc6c6135806e2bb5aed595438d6d3f20c3f62a9: Status 404 returned error can't find the container with id df1de95a4e0ad727b21c0d9fcfc6c6135806e2bb5aed595438d6d3f20c3f62a9 Jul 06 20:38:07.651474 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:07.651442 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c616a13-acea-496d-b696-1c15969eff50" path="/var/lib/kubelet/pods/4c616a13-acea-496d-b696-1c15969eff50/volumes" Jul 06 20:38:07.668541 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:07.668486 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e9d2898-542b-445c-8a79-c524e3dd06ff" containerID="9749a21b0a0485707c3b131a66d4d9b8ea6225c64fc88c23b6d8821e0566b1bb" exitCode=0 Jul 06 20:38:07.668900 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:07.668554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerDied","Data":"9749a21b0a0485707c3b131a66d4d9b8ea6225c64fc88c23b6d8821e0566b1bb"} Jul 06 20:38:07.668900 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:07.668620 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"df1de95a4e0ad727b21c0d9fcfc6c6135806e2bb5aed595438d6d3f20c3f62a9"} Jul 06 20:38:08.678328 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.678289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"9b1aae2d7c6fbf5007f28c96f44cbaf27f3bdece6fc0e8dc4a80ce996480f060"} Jul 06 20:38:08.678725 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.678351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"9cca311285178fc06866b52d2d965a192652e84b5671bbc6dfbc16e14b250419"} Jul 06 20:38:08.678725 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.678376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"bb866286eded6f7693343a86f7c251cd009471367553b3aed2405e3c539eb0f2"} Jul 06 20:38:08.678725 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.678403 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"4658222d613cbb423e36afbfa99581b0bd06315b1be968863ed612aac3a7ff2a"} Jul 06 20:38:08.678725 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.678431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"a2e14354ad9207250eaef194e0be3b75f16952dc68b4e050419776c1e1178d86"} Jul 06 20:38:08.678725 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.678460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e9d2898-542b-445c-8a79-c524e3dd06ff","Type":"ContainerStarted","Data":"5db6674875a6e0235190f6435784a3907124aed55bd23ea5dfc68a1477ed10a9"} Jul 06 20:38:08.687740 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.687705 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:38:08.688292 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.688260 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="prometheus" containerID="cri-o://32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" gracePeriod=600 Jul 06 20:38:08.688562 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.688279 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy" containerID="cri-o://6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" gracePeriod=600 Jul 06 20:38:08.688692 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.688315 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" gracePeriod=600 Jul 06 20:38:08.688692 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.688331 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="config-reloader" containerID="cri-o://34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" gracePeriod=600 Jul 06 20:38:08.688808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.688342 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="thanos-sidecar" containerID="cri-o://8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" gracePeriod=600 Jul 06 20:38:08.688808 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.688347 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-web" containerID="cri-o://6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" gracePeriod=600 Jul 06 20:38:08.717425 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.717365 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.701747859 podStartE2EDuration="2.717342665s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.594806ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:08.715926307 +0000 UTC m=+205.540230562" watchObservedRunningTime="2026-07-06 20:38:08.717342665 +0000 UTC m=+205.541646936" Jul 06 20:38:08.949672 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:08.948722 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.012036 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012001 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-2\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012036 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012046 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-metrics-client-certs\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012072 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config-out\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012100 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-trusted-ca-bundle\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012124 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-0\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-kube-rbac-proxy\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012178 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-tls\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012211 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-serving-certs-ca-bundle\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012254 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012284 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-grpc-tls\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012330 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012306 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-tls-assets\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012354 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012382 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-1\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012405 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-metrics-client-ca\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012441 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012463 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-web-config\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012500 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4bkg\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-kube-api-access-k4bkg\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012564 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-kubelet-serving-ca-bundle\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012606 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-db\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.012773 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012641 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-thanos-prometheus-http-client-file\") pod \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\" (UID: \"e28a4d31-b975-4797-96c5-08a1c0f6cdb5\") " Jul 06 20:38:09.015788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012399 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.015788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.012765 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.015788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.013601 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.015788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.015399 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.015788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.015326 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.015788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.015592 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.016155 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.015861 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.016704 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.016489 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.017111 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.016921 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.017544 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.017343 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config-out" (OuterVolumeSpecName: "config-out") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:38:09.017544 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.017457 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:38:09.017544 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.017486 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:09.018977 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.018951 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-kube-api-access-k4bkg" (OuterVolumeSpecName: "kube-api-access-k4bkg") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "kube-api-access-k4bkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:38:09.019586 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.019317 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.019586 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.019400 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.019586 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.019552 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.019788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.019768 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:38:09.019871 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.019855 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config" (OuterVolumeSpecName: "config") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.020033 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.020008 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.035696 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.035634 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-web-config" (OuterVolumeSpecName: "web-config") pod "e28a4d31-b975-4797-96c5-08a1c0f6cdb5" (UID: "e28a4d31-b975-4797-96c5-08a1c0f6cdb5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:09.114471 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114428 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114471 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114468 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114482 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-metrics-client-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114496 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114554 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-web-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114568 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4bkg\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-kube-api-access-k4bkg\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114581 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114591 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-db\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114599 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114607 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114615 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-metrics-client-certs\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114623 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-config-out\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114631 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114638 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114646 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-kube-rbac-proxy\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114655 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114663 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114672 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114680 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-secret-grpc-tls\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.114712 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.114687 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e28a4d31-b975-4797-96c5-08a1c0f6cdb5-tls-assets\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:09.685680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685646 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" exitCode=0 Jul 06 20:38:09.685680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685670 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" exitCode=0 Jul 06 20:38:09.685680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685678 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" exitCode=0 Jul 06 20:38:09.685680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685684 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" exitCode=0 Jul 06 20:38:09.685680 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685689 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" exitCode=0 Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685696 2578 generic.go:356] "Generic (PLEG): container finished" podID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" exitCode=0 Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685735 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685841 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685867 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.685969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} Jul 06 20:38:09.686185 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.686009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e28a4d31-b975-4797-96c5-08a1c0f6cdb5","Type":"ContainerDied","Data":"a3edd77d3775a70600681f0f607080dedaa3c3ab359d7eccb7f4721581cf2f76"} Jul 06 20:38:09.694453 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.694296 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.702163 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.702139 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.709703 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.709683 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.712777 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.712694 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:38:09.717643 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.717615 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:38:09.718884 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.718861 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.726609 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.726562 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.734570 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.734549 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.742161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.742141 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.742489 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.742463 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.742634 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.742500 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} err="failed to get container status \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" Jul 06 20:38:09.742634 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.742545 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.742807 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.742791 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.742846 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.742813 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} err="failed to get container status \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" Jul 06 20:38:09.742846 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.742827 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.743101 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.743083 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.743154 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743106 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} err="failed to get container status \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" Jul 06 20:38:09.743154 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743123 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.743344 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.743323 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.743390 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743348 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} err="failed to get container status \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" Jul 06 20:38:09.743390 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743362 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.743594 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.743579 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.743639 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743598 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} err="failed to get container status \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" Jul 06 20:38:09.743639 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743611 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.743836 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.743821 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.743881 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743839 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} err="failed to get container status \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" Jul 06 20:38:09.743881 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.743852 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.744039 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:09.744023 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.744089 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744042 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} err="failed to get container status \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" Jul 06 20:38:09.744089 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744052 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.744258 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744240 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} err="failed to get container status \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" Jul 06 20:38:09.744294 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744259 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.744464 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744449 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} err="failed to get container status \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" Jul 06 20:38:09.744464 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744463 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.744710 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744692 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} err="failed to get container status \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" Jul 06 20:38:09.744762 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744712 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.744944 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744926 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} err="failed to get container status \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" Jul 06 20:38:09.744980 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.744946 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.745168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745151 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} err="failed to get container status \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" Jul 06 20:38:09.745216 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745168 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.745371 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745354 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} err="failed to get container status \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" Jul 06 20:38:09.745420 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745371 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.745588 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745571 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} err="failed to get container status \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" Jul 06 20:38:09.745641 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745590 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.745780 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745765 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} err="failed to get container status \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" Jul 06 20:38:09.745823 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745781 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.745958 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745943 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} err="failed to get container status \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" Jul 06 20:38:09.746005 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.745957 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.746156 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746140 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} err="failed to get container status \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" Jul 06 20:38:09.746200 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746156 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.746377 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746360 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} err="failed to get container status \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" Jul 06 20:38:09.746423 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746376 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.746669 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746650 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} err="failed to get container status \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" Jul 06 20:38:09.746736 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746671 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.746903 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746886 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} err="failed to get container status \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" Jul 06 20:38:09.746957 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.746904 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.747113 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747096 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} err="failed to get container status \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" Jul 06 20:38:09.747158 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747114 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.747322 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747300 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} err="failed to get container status \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" Jul 06 20:38:09.747364 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747326 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.747570 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747554 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} err="failed to get container status \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" Jul 06 20:38:09.747610 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747571 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.747768 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747753 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} err="failed to get container status \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" Jul 06 20:38:09.747805 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747768 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.747970 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747952 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} err="failed to get container status \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" Jul 06 20:38:09.747970 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.747969 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.748147 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748129 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} err="failed to get container status \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" Jul 06 20:38:09.748187 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748149 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.748314 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748297 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} err="failed to get container status \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" Jul 06 20:38:09.748350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748315 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.748545 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748503 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} err="failed to get container status \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" Jul 06 20:38:09.748589 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748548 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.748764 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748748 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} err="failed to get container status \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" Jul 06 20:38:09.748806 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748764 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.748958 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748944 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} err="failed to get container status \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" Jul 06 20:38:09.748958 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.748957 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.749150 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749134 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} err="failed to get container status \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" Jul 06 20:38:09.749194 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749151 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.749361 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749346 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} err="failed to get container status \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" Jul 06 20:38:09.749400 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749361 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.749570 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749554 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} err="failed to get container status \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" Jul 06 20:38:09.749621 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749570 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.749760 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749741 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} err="failed to get container status \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" Jul 06 20:38:09.749798 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749761 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.749942 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749923 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} err="failed to get container status \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" Jul 06 20:38:09.749981 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.749944 2578 scope.go:117] "RemoveContainer" containerID="a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c" Jul 06 20:38:09.750121 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750104 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c"} err="failed to get container status \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": rpc error: code = NotFound desc = could not find container \"a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c\": container with ID starting with a3b5d37a070c598f6d39eefe762936552b55720b2f0a1cd03d18bcc268e7389c not found: ID does not exist" Jul 06 20:38:09.750165 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750124 2578 scope.go:117] "RemoveContainer" containerID="6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52" Jul 06 20:38:09.750316 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750302 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52"} err="failed to get container status \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": rpc error: code = NotFound desc = could not find container \"6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52\": container with ID starting with 6698c729aae76f0ec93ebbac6a9d722c21119cc46c7e78ca9cb35c14d89b3c52 not found: ID does not exist" Jul 06 20:38:09.750316 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750315 2578 scope.go:117] "RemoveContainer" containerID="6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87" Jul 06 20:38:09.750540 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750499 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87"} err="failed to get container status \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": rpc error: code = NotFound desc = could not find container \"6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87\": container with ID starting with 6044899ba85a9b60bda221c60d92f2b0246295a6151582ca8967f14d93daad87 not found: ID does not exist" Jul 06 20:38:09.750582 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750542 2578 scope.go:117] "RemoveContainer" containerID="8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0" Jul 06 20:38:09.750736 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750721 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0"} err="failed to get container status \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": rpc error: code = NotFound desc = could not find container \"8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0\": container with ID starting with 8376c2eef3522b0475617de37efbe46d0b0510b99751db23f52e125dc88adfb0 not found: ID does not exist" Jul 06 20:38:09.750786 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750737 2578 scope.go:117] "RemoveContainer" containerID="34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd" Jul 06 20:38:09.750931 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750914 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd"} err="failed to get container status \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": rpc error: code = NotFound desc = could not find container \"34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd\": container with ID starting with 34e29c6ca046e9adb8711bf22ec57f56b12662647a6af2f4a5d231b632ee2cdd not found: ID does not exist" Jul 06 20:38:09.750966 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.750932 2578 scope.go:117] "RemoveContainer" containerID="32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8" Jul 06 20:38:09.751135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.751122 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8"} err="failed to get container status \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": rpc error: code = NotFound desc = could not find container \"32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8\": container with ID starting with 32f9cd25eaad79c25c17a8ae81d3c4fa46eead3e31c0fd6cc4fc312f4a32b0d8 not found: ID does not exist" Jul 06 20:38:09.751176 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.751136 2578 scope.go:117] "RemoveContainer" containerID="651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f" Jul 06 20:38:09.751343 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.751318 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f"} err="failed to get container status \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": rpc error: code = NotFound desc = could not find container \"651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f\": container with ID starting with 651391dac679bc5ad46010aad6ce5552bb5e001d6d0c09e8890e63a24ead9b9f not found: ID does not exist" Jul 06 20:38:09.753577 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753511 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:38:09.753840 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753829 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="thanos-sidecar" Jul 06 20:38:09.753875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753842 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="thanos-sidecar" Jul 06 20:38:09.753875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753851 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy" Jul 06 20:38:09.753875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753856 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy" Jul 06 20:38:09.753875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753865 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="prometheus" Jul 06 20:38:09.753875 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753871 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="prometheus" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753878 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="init-config-reloader" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753883 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="init-config-reloader" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753891 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="config-reloader" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753896 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="config-reloader" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753911 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-web" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753917 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-web" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753924 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-thanos" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753929 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-thanos" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753983 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="config-reloader" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753991 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.753996 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-thanos" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.754003 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="prometheus" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.754009 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="thanos-sidecar" Jul 06 20:38:09.754029 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.754014 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" containerName="kube-rbac-proxy-web" Jul 06 20:38:09.759096 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.759078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.762035 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:38:09.762119 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:38:09.762943 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762945 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.762905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.763401 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.763511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6bs6tss69aare\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.763544 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.763675 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ccxpt\"" Jul 06 20:38:09.764508 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.763681 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:38:09.765698 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.765559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:38:09.766589 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.766568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:38:09.770162 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.770145 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:38:09.787136 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.787108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:38:09.821616 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.821788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.821788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.821788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.821788 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4df98d8-011d-436a-ba0d-a715983d063f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-config\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7msfx\" (UniqueName: \"kubernetes.io/projected/e4df98d8-011d-436a-ba0d-a715983d063f-kube-api-access-7msfx\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.821989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4df98d8-011d-436a-ba0d-a715983d063f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822135 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822481 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822481 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.822481 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.822200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.922664 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-config\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.922664 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7msfx\" (UniqueName: \"kubernetes.io/projected/e4df98d8-011d-436a-ba0d-a715983d063f-kube-api-access-7msfx\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4df98d8-011d-436a-ba0d-a715983d063f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.922968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.923262 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.924254 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4df98d8-011d-436a-ba0d-a715983d063f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.924254 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.924254 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.923471 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.925335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.924552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.925335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.924626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.925335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.924855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.926069 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.925947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4df98d8-011d-436a-ba0d-a715983d063f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.926069 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.925969 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.926733 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.926238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.926733 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.926308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.926733 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.926611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-config\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.927257 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.926923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.927257 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.927211 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4df98d8-011d-436a-ba0d-a715983d063f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.927257 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.927214 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.927664 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.927640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.928547 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.928486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.928632 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.928620 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.928958 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.928933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.929414 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.929394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4df98d8-011d-436a-ba0d-a715983d063f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.929510 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.929494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4df98d8-011d-436a-ba0d-a715983d063f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:09.933062 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:09.933045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7msfx\" (UniqueName: \"kubernetes.io/projected/e4df98d8-011d-436a-ba0d-a715983d063f-kube-api-access-7msfx\") pod \"prometheus-k8s-0\" (UID: \"e4df98d8-011d-436a-ba0d-a715983d063f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:10.069994 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.069893 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:10.218774 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.218746 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:38:10.220452 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:38:10.220426 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4df98d8_011d_436a_ba0d_a715983d063f.slice/crio-5151cb38ab694ca323e370bde03701aceb54f53f462c4177de24af7ca5c9f130 WatchSource:0}: Error finding container 5151cb38ab694ca323e370bde03701aceb54f53f462c4177de24af7ca5c9f130: Status 404 returned error can't find the container with id 5151cb38ab694ca323e370bde03701aceb54f53f462c4177de24af7ca5c9f130 Jul 06 20:38:10.552113 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.552060 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:10.552315 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.552141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:10.556850 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.556829 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:10.691996 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.691958 2578 generic.go:356] "Generic (PLEG): container finished" podID="e4df98d8-011d-436a-ba0d-a715983d063f" containerID="77f5b7928ca33c3de732fd40060dc744d93459eb6112c50f4e6586a6c6bff49d" exitCode=0 Jul 06 20:38:10.692434 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.692045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerDied","Data":"77f5b7928ca33c3de732fd40060dc744d93459eb6112c50f4e6586a6c6bff49d"} Jul 06 20:38:10.692434 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.692117 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"5151cb38ab694ca323e370bde03701aceb54f53f462c4177de24af7ca5c9f130"} Jul 06 20:38:10.696062 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.696037 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:38:10.779727 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:10.779699 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8589b878d5-qtsvr"] Jul 06 20:38:11.653134 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.653100 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28a4d31-b975-4797-96c5-08a1c0f6cdb5" path="/var/lib/kubelet/pods/e28a4d31-b975-4797-96c5-08a1c0f6cdb5/volumes" Jul 06 20:38:11.699644 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.699609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"9a88fa374119cbc64e3b3b7357478c0027b9e69c30244e9549952209847d11a6"} Jul 06 20:38:11.700030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.699676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"97cf0ae9ddc1868345e0ff92a44da8e1a3260d04855f038d40c2ee5fb14ce968"} Jul 06 20:38:11.700030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.699701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"f2c364ec46cb41ef87b72e22697e265fecbb18be7ed57c3d1af2436e0ee3d396"} Jul 06 20:38:11.700030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.699724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"7f3f894e3e10c991ebe0257f8fae14c31096cae7d43654a79a5ec3dd8649ce9c"} Jul 06 20:38:11.700030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.699747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"c02c6cb756afc1424b0c9635c6de1897a73b12e1a77553ee64a1e2ec7fc67e92"} Jul 06 20:38:11.700030 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.699770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4df98d8-011d-436a-ba0d-a715983d063f","Type":"ContainerStarted","Data":"aa2a4cffb362fb573606752a91a26ed644b185f9306e37036ba96321a949595e"} Jul 06 20:38:11.732340 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:11.732273 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7120286609999997 podStartE2EDuration="2.732256273s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.227612ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:11.730201469 +0000 UTC m=+208.554505721" watchObservedRunningTime="2026-07-06 20:38:11.732256273 +0000 UTC m=+208.556560521" Jul 06 20:38:15.070314 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:15.070269 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:38:35.815930 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:35.815874 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8589b878d5-qtsvr" podUID="551940f2-ca49-4097-816f-9ff6a4803ca8" containerName="console" containerID="cri-o://7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37" gracePeriod=15 Jul 06 20:38:36.064878 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.064851 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:38:36.166759 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166670 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-oauth-serving-cert\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.166759 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166724 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-oauth-config\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.166759 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166743 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fpfk\" (UniqueName: \"kubernetes.io/projected/551940f2-ca49-4097-816f-9ff6a4803ca8-kube-api-access-6fpfk\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.166759 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166759 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-console-config\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.167061 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166848 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-service-ca\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.167061 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-serving-cert\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.167061 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.166910 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-trusted-ca-bundle\") pod \"551940f2-ca49-4097-816f-9ff6a4803ca8\" (UID: \"551940f2-ca49-4097-816f-9ff6a4803ca8\") " Jul 06 20:38:36.167210 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.167191 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:36.167210 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.167194 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-console-config" (OuterVolumeSpecName: "console-config") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:36.167312 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.167228 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-service-ca" (OuterVolumeSpecName: "service-ca") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:36.167705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.167681 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:36.169024 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.168994 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:36.169024 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.169006 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551940f2-ca49-4097-816f-9ff6a4803ca8-kube-api-access-6fpfk" (OuterVolumeSpecName: "kube-api-access-6fpfk") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "kube-api-access-6fpfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:38:36.169154 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.169047 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "551940f2-ca49-4097-816f-9ff6a4803ca8" (UID: "551940f2-ca49-4097-816f-9ff6a4803ca8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:36.268350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268314 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-service-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.268350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268344 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.268350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268354 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-trusted-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.268350 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268362 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-oauth-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.268667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268370 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/551940f2-ca49-4097-816f-9ff6a4803ca8-console-oauth-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.268667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268379 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fpfk\" (UniqueName: \"kubernetes.io/projected/551940f2-ca49-4097-816f-9ff6a4803ca8-kube-api-access-6fpfk\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.268667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.268388 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/551940f2-ca49-4097-816f-9ff6a4803ca8-console-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:38:36.808966 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.808923 2578 generic.go:356] "Generic (PLEG): container finished" podID="551940f2-ca49-4097-816f-9ff6a4803ca8" containerID="7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37" exitCode=0 Jul 06 20:38:36.808966 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.808970 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8589b878d5-qtsvr" Jul 06 20:38:36.809335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.809012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8589b878d5-qtsvr" event={"ID":"551940f2-ca49-4097-816f-9ff6a4803ca8","Type":"ContainerDied","Data":"7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37"} Jul 06 20:38:36.809335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.809066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8589b878d5-qtsvr" event={"ID":"551940f2-ca49-4097-816f-9ff6a4803ca8","Type":"ContainerDied","Data":"6f6373919f6a06e66c4ccae5d24a682a0b203f88f81b7cddffd626c7394bd99d"} Jul 06 20:38:36.809335 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.809091 2578 scope.go:117] "RemoveContainer" containerID="7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37" Jul 06 20:38:36.818004 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.817830 2578 scope.go:117] "RemoveContainer" containerID="7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37" Jul 06 20:38:36.818236 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:38:36.818156 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37\": container with ID starting with 7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37 not found: ID does not exist" containerID="7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37" Jul 06 20:38:36.818236 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.818180 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37"} err="failed to get container status \"7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37\": rpc error: code = NotFound desc = could not find container \"7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37\": container with ID starting with 7019fe8e9102e5bcf18e5f5f3ae85729c2040272f36f3bbbf24081c322f42b37 not found: ID does not exist" Jul 06 20:38:36.832488 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.832455 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8589b878d5-qtsvr"] Jul 06 20:38:36.838160 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:36.838129 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8589b878d5-qtsvr"] Jul 06 20:38:37.651784 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:38:37.651750 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="551940f2-ca49-4097-816f-9ff6a4803ca8" path="/var/lib/kubelet/pods/551940f2-ca49-4097-816f-9ff6a4803ca8/volumes" Jul 06 20:39:10.070575 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:39:10.070464 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:39:10.086681 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:39:10.086647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:39:10.966495 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:39:10.966467 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:39:43.561711 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:39:43.561669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:39:43.565018 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:39:43.564995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:39:43.572036 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:39:43.572014 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:42:05.663716 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.663639 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4dbd86b7-vvp7d"] Jul 06 20:42:05.664168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.663982 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551940f2-ca49-4097-816f-9ff6a4803ca8" containerName="console" Jul 06 20:42:05.664168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.663993 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="551940f2-ca49-4097-816f-9ff6a4803ca8" containerName="console" Jul 06 20:42:05.664168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.664041 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="551940f2-ca49-4097-816f-9ff6a4803ca8" containerName="console" Jul 06 20:42:05.666768 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.666746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.677675 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.677646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4dbd86b7-vvp7d"] Jul 06 20:42:05.767664 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-serving-cert\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.767839 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-oauth-serving-cert\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.767839 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-oauth-config\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.767839 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-trusted-ca-bundle\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.767839 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88zlt\" (UniqueName: \"kubernetes.io/projected/33b674f2-2b1c-4646-b8b1-c190b65a8820-kube-api-access-88zlt\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.767839 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-config\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.768002 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.767843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-service-ca\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.869914 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.869873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-oauth-serving-cert\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870107 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.869944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-oauth-config\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870107 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.869980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-trusted-ca-bundle\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870107 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88zlt\" (UniqueName: \"kubernetes.io/projected/33b674f2-2b1c-4646-b8b1-c190b65a8820-kube-api-access-88zlt\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870107 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-config\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870107 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-service-ca\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870344 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-serving-cert\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870761 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-config\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870864 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-oauth-serving-cert\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.870864 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.870824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-trusted-ca-bundle\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.871055 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.871032 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b674f2-2b1c-4646-b8b1-c190b65a8820-service-ca\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.872640 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.872620 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-oauth-config\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.872752 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.872737 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b674f2-2b1c-4646-b8b1-c190b65a8820-console-serving-cert\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.880896 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.880866 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88zlt\" (UniqueName: \"kubernetes.io/projected/33b674f2-2b1c-4646-b8b1-c190b65a8820-kube-api-access-88zlt\") pod \"console-5b4dbd86b7-vvp7d\" (UID: \"33b674f2-2b1c-4646-b8b1-c190b65a8820\") " pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:05.980623 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:05.980514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:06.117580 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:06.117555 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4dbd86b7-vvp7d"] Jul 06 20:42:06.119831 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:42:06.119802 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b674f2_2b1c_4646_b8b1_c190b65a8820.slice/crio-74e4e7072a632a42537bd61ecdd549be3c5687cb65a1fa015b0a3d363a8c99f1 WatchSource:0}: Error finding container 74e4e7072a632a42537bd61ecdd549be3c5687cb65a1fa015b0a3d363a8c99f1: Status 404 returned error can't find the container with id 74e4e7072a632a42537bd61ecdd549be3c5687cb65a1fa015b0a3d363a8c99f1 Jul 06 20:42:06.686019 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:06.685982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4dbd86b7-vvp7d" event={"ID":"33b674f2-2b1c-4646-b8b1-c190b65a8820","Type":"ContainerStarted","Data":"99011f675e21c2f34de4aa7189c7fbbecf37f213e7cf032a2306d48d54cdaa78"} Jul 06 20:42:06.686492 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:06.686030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4dbd86b7-vvp7d" event={"ID":"33b674f2-2b1c-4646-b8b1-c190b65a8820","Type":"ContainerStarted","Data":"74e4e7072a632a42537bd61ecdd549be3c5687cb65a1fa015b0a3d363a8c99f1"} Jul 06 20:42:15.980653 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:15.980621 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:15.981021 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:15.980807 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:15.985179 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:15.985158 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:16.007074 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:16.007025 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4dbd86b7-vvp7d" podStartSLOduration=11.0070099 podStartE2EDuration="11.0070099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:42:06.723766867 +0000 UTC m=+443.548071117" watchObservedRunningTime="2026-07-06 20:42:16.0070099 +0000 UTC m=+452.831314152" Jul 06 20:42:16.730400 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:16.730368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4dbd86b7-vvp7d" Jul 06 20:42:16.820771 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:16.820737 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fbb6765-ljphg"] Jul 06 20:42:41.840497 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:41.840457 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85fbb6765-ljphg" podUID="3006a63c-54b2-440b-b162-5aa3653bfbe9" containerName="console" containerID="cri-o://b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905" gracePeriod=15 Jul 06 20:42:42.084483 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.084456 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:42:42.196857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.196761 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-service-ca\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.196857 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.196836 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-oauth-serving-cert\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.197060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.196862 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-serving-cert\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.197060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.196893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9swt2\" (UniqueName: \"kubernetes.io/projected/3006a63c-54b2-440b-b162-5aa3653bfbe9-kube-api-access-9swt2\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.197060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.196963 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-config\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.197060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.196992 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-trusted-ca-bundle\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.197060 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.197025 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-oauth-config\") pod \"3006a63c-54b2-440b-b162-5aa3653bfbe9\" (UID: \"3006a63c-54b2-440b-b162-5aa3653bfbe9\") " Jul 06 20:42:42.197423 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.197391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-config" (OuterVolumeSpecName: "console-config") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:42.197423 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.197406 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:42.197617 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.197463 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:42.197617 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.197493 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-service-ca" (OuterVolumeSpecName: "service-ca") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:42.199242 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.199218 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:42:42.199339 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.199236 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3006a63c-54b2-440b-b162-5aa3653bfbe9-kube-api-access-9swt2" (OuterVolumeSpecName: "kube-api-access-9swt2") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "kube-api-access-9swt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:42:42.199339 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.199248 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3006a63c-54b2-440b-b162-5aa3653bfbe9" (UID: "3006a63c-54b2-440b-b162-5aa3653bfbe9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:42:42.298705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298654 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-oauth-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.298705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298697 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-serving-cert\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.298705 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298710 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9swt2\" (UniqueName: \"kubernetes.io/projected/3006a63c-54b2-440b-b162-5aa3653bfbe9-kube-api-access-9swt2\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.298954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298722 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.298954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298734 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-trusted-ca-bundle\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.298954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298745 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3006a63c-54b2-440b-b162-5aa3653bfbe9-console-oauth-config\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.298954 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.298755 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3006a63c-54b2-440b-b162-5aa3653bfbe9-service-ca\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:42:42.839160 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.839126 2578 generic.go:356] "Generic (PLEG): container finished" podID="3006a63c-54b2-440b-b162-5aa3653bfbe9" containerID="b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905" exitCode=0 Jul 06 20:42:42.839317 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.839177 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbb6765-ljphg" Jul 06 20:42:42.839317 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.839218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbb6765-ljphg" event={"ID":"3006a63c-54b2-440b-b162-5aa3653bfbe9","Type":"ContainerDied","Data":"b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905"} Jul 06 20:42:42.839317 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.839274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbb6765-ljphg" event={"ID":"3006a63c-54b2-440b-b162-5aa3653bfbe9","Type":"ContainerDied","Data":"23672590ea4f61afc751ce6398dbdb3a44776526ad9e668e7d2c296c967f7022"} Jul 06 20:42:42.839317 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.839300 2578 scope.go:117] "RemoveContainer" containerID="b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905" Jul 06 20:42:42.850616 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.850376 2578 scope.go:117] "RemoveContainer" containerID="b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905" Jul 06 20:42:42.850887 ip-10-0-130-92 kubenswrapper[2578]: E0706 20:42:42.850823 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905\": container with ID starting with b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905 not found: ID does not exist" containerID="b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905" Jul 06 20:42:42.850887 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.850858 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905"} err="failed to get container status \"b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905\": rpc error: code = NotFound desc = could not find container \"b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905\": container with ID starting with b1569be67d875614d499e6c54580af827c46fe84badd4d8ecca0483e9ceba905 not found: ID does not exist" Jul 06 20:42:42.864237 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.864210 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fbb6765-ljphg"] Jul 06 20:42:42.869666 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:42.869635 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85fbb6765-ljphg"] Jul 06 20:42:43.651302 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:43.651269 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3006a63c-54b2-440b-b162-5aa3653bfbe9" path="/var/lib/kubelet/pods/3006a63c-54b2-440b-b162-5aa3653bfbe9/volumes" Jul 06 20:42:59.543645 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.543613 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-pgvs9"] Jul 06 20:42:59.544128 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.543983 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3006a63c-54b2-440b-b162-5aa3653bfbe9" containerName="console" Jul 06 20:42:59.544128 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.543997 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3006a63c-54b2-440b-b162-5aa3653bfbe9" containerName="console" Jul 06 20:42:59.544128 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.544066 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3006a63c-54b2-440b-b162-5aa3653bfbe9" containerName="console" Jul 06 20:42:59.551233 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.551202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.553734 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.553703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4392d5b4-192b-470a-b410-4349dd1e8f0e-model-cache\") pod \"s3-init-pgvs9\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.553890 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.553823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qrfp\" (UniqueName: \"kubernetes.io/projected/4392d5b4-192b-470a-b410-4349dd1e8f0e-kube-api-access-8qrfp\") pod \"s3-init-pgvs9\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.554566 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.554507 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 20:42:59.554701 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.554581 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-prb56\"" Jul 06 20:42:59.554701 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.554627 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.554827 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.554781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.555452 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.555432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-pgvs9"] Jul 06 20:42:59.654647 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.654621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4392d5b4-192b-470a-b410-4349dd1e8f0e-model-cache\") pod \"s3-init-pgvs9\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.654816 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.654776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qrfp\" (UniqueName: \"kubernetes.io/projected/4392d5b4-192b-470a-b410-4349dd1e8f0e-kube-api-access-8qrfp\") pod \"s3-init-pgvs9\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.655044 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.655020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4392d5b4-192b-470a-b410-4349dd1e8f0e-model-cache\") pod \"s3-init-pgvs9\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.665017 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.664996 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qrfp\" (UniqueName: \"kubernetes.io/projected/4392d5b4-192b-470a-b410-4349dd1e8f0e-kube-api-access-8qrfp\") pod \"s3-init-pgvs9\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " pod="kserve/s3-init-pgvs9" Jul 06 20:42:59.873575 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:42:59.873478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pgvs9" Jul 06 20:43:00.013149 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:00.013082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-pgvs9"] Jul 06 20:43:00.015798 ip-10-0-130-92 kubenswrapper[2578]: W0706 20:43:00.015770 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4392d5b4_192b_470a_b410_4349dd1e8f0e.slice/crio-784747bbe64794f6356fa5d4181ca95adf8881b9e0f55b06c5fb98616ffad420 WatchSource:0}: Error finding container 784747bbe64794f6356fa5d4181ca95adf8881b9e0f55b06c5fb98616ffad420: Status 404 returned error can't find the container with id 784747bbe64794f6356fa5d4181ca95adf8881b9e0f55b06c5fb98616ffad420 Jul 06 20:43:00.017635 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:00.017621 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:43:00.918748 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:00.918700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pgvs9" event={"ID":"4392d5b4-192b-470a-b410-4349dd1e8f0e","Type":"ContainerStarted","Data":"784747bbe64794f6356fa5d4181ca95adf8881b9e0f55b06c5fb98616ffad420"} Jul 06 20:43:04.939569 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:04.939515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pgvs9" event={"ID":"4392d5b4-192b-470a-b410-4349dd1e8f0e","Type":"ContainerStarted","Data":"1ee6473236a5a5de1ac590ca4affea2687ba2af21911f6ee7c2970cbe9a4946c"} Jul 06 20:43:05.945416 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:05.945383 2578 generic.go:356] "Generic (PLEG): container finished" podID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerID="1ee6473236a5a5de1ac590ca4affea2687ba2af21911f6ee7c2970cbe9a4946c" exitCode=0 Jul 06 20:43:05.945955 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:05.945431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pgvs9" event={"ID":"4392d5b4-192b-470a-b410-4349dd1e8f0e","Type":"ContainerDied","Data":"1ee6473236a5a5de1ac590ca4affea2687ba2af21911f6ee7c2970cbe9a4946c"} Jul 06 20:43:10.971764 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:10.971716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pgvs9" event={"ID":"4392d5b4-192b-470a-b410-4349dd1e8f0e","Type":"ContainerStarted","Data":"f6d74dac6689c851140494dc69f6837a73612dc32d75ba2ec6ab6da76e63ecc6"} Jul 06 20:43:10.991168 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:10.991115 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-pgvs9" podStartSLOduration=1.687327757 podStartE2EDuration="11.991098139s" totalImagesPullingTime="9.101301593s" totalInitContainerRuntime="1.202468789s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:10.991009276 +0000 UTC m=+507.815313529" watchObservedRunningTime="2026-07-06 20:43:10.991098139 +0000 UTC m=+507.815402393" Jul 06 20:43:43.621996 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.621967 2578 scope.go:117] "RemoveContainer" containerID="bddc313df75ce4fb7a7876ef52f826549528ede9fc768e5690e94f781a1119d1" Jul 06 20:43:43.629856 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.629834 2578 scope.go:117] "RemoveContainer" containerID="c37744b3907dfc1a61d01b1691795f9773fb78ccc285dcbb75d303b9dda9e848" Jul 06 20:43:43.637056 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.637034 2578 scope.go:117] "RemoveContainer" containerID="419a1e272cebe55ceaa19c14a72dbd9ffadca0ef9ec9fab80671d594683bf52f" Jul 06 20:43:43.644128 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.644107 2578 scope.go:117] "RemoveContainer" containerID="6c6b9578a5eb2c16fc180d60a11251f7ef7f51549ced5dbbbbee587fdc7a7457" Jul 06 20:43:43.653080 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.653065 2578 scope.go:117] "RemoveContainer" containerID="1889cc9dfa4a96f4a3d74216e57345059b0c57b7d45284ced9bd555a4e84468b" Jul 06 20:43:43.660298 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.660277 2578 scope.go:117] "RemoveContainer" containerID="287a973c84e31dfe940dd336f8992833c175156afc674f0676764f89fb36363e" Jul 06 20:43:43.667161 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:43:43.667143 2578 scope.go:117] "RemoveContainer" containerID="618f0af0c4c31c7ca9d868d09e4c5f868569064667cf01c3ac8c6675eed33b52" Jul 06 20:44:16.248070 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:16.248036 2578 generic.go:356] "Generic (PLEG): container finished" podID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerID="f6d74dac6689c851140494dc69f6837a73612dc32d75ba2ec6ab6da76e63ecc6" exitCode=0 Jul 06 20:44:16.248615 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:16.248114 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pgvs9" event={"ID":"4392d5b4-192b-470a-b410-4349dd1e8f0e","Type":"ContainerDied","Data":"f6d74dac6689c851140494dc69f6837a73612dc32d75ba2ec6ab6da76e63ecc6"} Jul 06 20:44:17.392013 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.391981 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pgvs9" Jul 06 20:44:17.566343 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.566244 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qrfp\" (UniqueName: \"kubernetes.io/projected/4392d5b4-192b-470a-b410-4349dd1e8f0e-kube-api-access-8qrfp\") pod \"4392d5b4-192b-470a-b410-4349dd1e8f0e\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " Jul 06 20:44:17.566504 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.566365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4392d5b4-192b-470a-b410-4349dd1e8f0e-model-cache\") pod \"4392d5b4-192b-470a-b410-4349dd1e8f0e\" (UID: \"4392d5b4-192b-470a-b410-4349dd1e8f0e\") " Jul 06 20:44:17.568618 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.568590 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4392d5b4-192b-470a-b410-4349dd1e8f0e-kube-api-access-8qrfp" (OuterVolumeSpecName: "kube-api-access-8qrfp") pod "4392d5b4-192b-470a-b410-4349dd1e8f0e" (UID: "4392d5b4-192b-470a-b410-4349dd1e8f0e"). InnerVolumeSpecName "kube-api-access-8qrfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:44:17.584667 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.584629 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4392d5b4-192b-470a-b410-4349dd1e8f0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4392d5b4-192b-470a-b410-4349dd1e8f0e" (UID: "4392d5b4-192b-470a-b410-4349dd1e8f0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:44:17.667512 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.667485 2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4392d5b4-192b-470a-b410-4349dd1e8f0e-model-cache\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:44:17.667512 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:17.667510 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qrfp\" (UniqueName: \"kubernetes.io/projected/4392d5b4-192b-470a-b410-4349dd1e8f0e-kube-api-access-8qrfp\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 20:44:18.258284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:18.258252 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pgvs9" Jul 06 20:44:18.258284 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:18.258263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pgvs9" event={"ID":"4392d5b4-192b-470a-b410-4349dd1e8f0e","Type":"ContainerDied","Data":"784747bbe64794f6356fa5d4181ca95adf8881b9e0f55b06c5fb98616ffad420"} Jul 06 20:44:18.258490 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:18.258297 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="784747bbe64794f6356fa5d4181ca95adf8881b9e0f55b06c5fb98616ffad420" Jul 06 20:44:43.595315 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:43.595283 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:44:43.595845 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:44:43.595280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:49:43.621909 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:49:43.621877 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:49:43.622420 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:49:43.622263 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:54:43.649241 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:54:43.649215 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:54:43.650639 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:54:43.650613 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:59:43.675733 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:59:43.675702 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 20:59:43.678351 ip-10-0-130-92 kubenswrapper[2578]: I0706 20:59:43.678327 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 21:00:04.510857 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.510647 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-blbcq/must-gather-lmw8p"] Jul 06 21:00:04.511500 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.511474 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerName="download-hf-model" Jul 06 21:00:04.511727 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.511711 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerName="download-hf-model" Jul 06 21:00:04.511819 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.511809 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerName="s3-init" Jul 06 21:00:04.511901 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.511892 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerName="s3-init" Jul 06 21:00:04.512142 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.512130 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4392d5b4-192b-470a-b410-4349dd1e8f0e" containerName="s3-init" Jul 06 21:00:04.516210 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.516188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.519563 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.519535 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-blbcq\"/\"kube-root-ca.crt\"" Jul 06 21:00:04.520763 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.520730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-blbcq\"/\"default-dockercfg-vp6tk\"" Jul 06 21:00:04.520865 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.520813 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-blbcq\"/\"openshift-service-ca.crt\"" Jul 06 21:00:04.523133 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.523110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-blbcq/must-gather-lmw8p"] Jul 06 21:00:04.556975 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.556940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a1b1830-0d37-4b03-a35b-d216023d5bfe-must-gather-output\") pod \"must-gather-lmw8p\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.557135 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.557004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmbc\" (UniqueName: \"kubernetes.io/projected/9a1b1830-0d37-4b03-a35b-d216023d5bfe-kube-api-access-jrmbc\") pod \"must-gather-lmw8p\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.658051 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.658013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmbc\" (UniqueName: \"kubernetes.io/projected/9a1b1830-0d37-4b03-a35b-d216023d5bfe-kube-api-access-jrmbc\") pod \"must-gather-lmw8p\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.658222 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.658076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a1b1830-0d37-4b03-a35b-d216023d5bfe-must-gather-output\") pod \"must-gather-lmw8p\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.658361 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.658346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a1b1830-0d37-4b03-a35b-d216023d5bfe-must-gather-output\") pod \"must-gather-lmw8p\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.668622 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.668592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmbc\" (UniqueName: \"kubernetes.io/projected/9a1b1830-0d37-4b03-a35b-d216023d5bfe-kube-api-access-jrmbc\") pod \"must-gather-lmw8p\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.834913 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.834829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:04.967361 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.967335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-blbcq/must-gather-lmw8p"] Jul 06 21:00:04.969793 ip-10-0-130-92 kubenswrapper[2578]: W0706 21:00:04.969764 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a1b1830_0d37_4b03_a35b_d216023d5bfe.slice/crio-566d6119c10d50aa390cf1be305807e97c3d2c766b9dd0128871e6f6babd1c12 WatchSource:0}: Error finding container 566d6119c10d50aa390cf1be305807e97c3d2c766b9dd0128871e6f6babd1c12: Status 404 returned error can't find the container with id 566d6119c10d50aa390cf1be305807e97c3d2c766b9dd0128871e6f6babd1c12 Jul 06 21:00:04.971504 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:04.971488 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:00:05.126069 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:05.125986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-blbcq/must-gather-lmw8p" event={"ID":"9a1b1830-0d37-4b03-a35b-d216023d5bfe","Type":"ContainerStarted","Data":"566d6119c10d50aa390cf1be305807e97c3d2c766b9dd0128871e6f6babd1c12"} Jul 06 21:00:12.165493 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:12.165449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-blbcq/must-gather-lmw8p" event={"ID":"9a1b1830-0d37-4b03-a35b-d216023d5bfe","Type":"ContainerStarted","Data":"a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229"} Jul 06 21:00:12.165493 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:12.165499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-blbcq/must-gather-lmw8p" event={"ID":"9a1b1830-0d37-4b03-a35b-d216023d5bfe","Type":"ContainerStarted","Data":"d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3"} Jul 06 21:00:12.187406 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:12.187349 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-blbcq/must-gather-lmw8p" podStartSLOduration=2.115223234 podStartE2EDuration="8.187333991s" totalImagesPullingTime="6.072110757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:12.186363097 +0000 UTC m=+1529.010667376" watchObservedRunningTime="2026-07-06 21:00:12.187333991 +0000 UTC m=+1529.011638245" Jul 06 21:00:34.262506 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:34.262471 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerID="d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3" exitCode=0 Jul 06 21:00:34.262928 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:34.262552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-blbcq/must-gather-lmw8p" event={"ID":"9a1b1830-0d37-4b03-a35b-d216023d5bfe","Type":"ContainerDied","Data":"d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3"} Jul 06 21:00:34.262928 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:34.262855 2578 scope.go:117] "RemoveContainer" containerID="d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3" Jul 06 21:00:34.423844 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:34.423811 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-blbcq_must-gather-lmw8p_9a1b1830-0d37-4b03-a35b-d216023d5bfe/gather/0.log" Jul 06 21:00:38.000255 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:38.000221 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vvbsl_809917ad-8294-4c00-826e-c6840d28d0ae/global-pull-secret-syncer/0.log" Jul 06 21:00:38.101595 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:38.101564 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-94s42_b6950a35-0ecf-4adf-b199-54041fbf2355/konnectivity-agent/0.log" Jul 06 21:00:38.197568 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:38.197513 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-92.ec2.internal_9f4db311b901a006fd4141a884f57806/haproxy/0.log" Jul 06 21:00:39.826116 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:39.826081 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-blbcq/must-gather-lmw8p"] Jul 06 21:00:39.826579 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:39.826271 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-blbcq/must-gather-lmw8p" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="copy" containerID="cri-o://a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229" gracePeriod=2 Jul 06 21:00:39.828809 ip-10-0-130-92 kubenswrapper[2578]: E0706 21:00:39.828773 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lmw8p\" is forbidden: User \"system:node:ip-10-0-130-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-blbcq\": no relationship found between node 'ip-10-0-130-92.ec2.internal' and this object" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:39.829928 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:39.829906 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-blbcq/must-gather-lmw8p"] Jul 06 21:00:40.053500 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.053477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-blbcq_must-gather-lmw8p_9a1b1830-0d37-4b03-a35b-d216023d5bfe/copy/0.log" Jul 06 21:00:40.055355 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.055337 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:40.058666 ip-10-0-130-92 kubenswrapper[2578]: E0706 21:00:40.058636 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lmw8p\" is forbidden: User \"system:node:ip-10-0-130-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-blbcq\": no relationship found between node 'ip-10-0-130-92.ec2.internal' and this object" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:40.189550 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.189426 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a1b1830-0d37-4b03-a35b-d216023d5bfe-must-gather-output\") pod \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " Jul 06 21:00:40.189550 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.189466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrmbc\" (UniqueName: \"kubernetes.io/projected/9a1b1830-0d37-4b03-a35b-d216023d5bfe-kube-api-access-jrmbc\") pod \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\" (UID: \"9a1b1830-0d37-4b03-a35b-d216023d5bfe\") " Jul 06 21:00:40.190836 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.190806 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1b1830-0d37-4b03-a35b-d216023d5bfe-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9a1b1830-0d37-4b03-a35b-d216023d5bfe" (UID: "9a1b1830-0d37-4b03-a35b-d216023d5bfe"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:00:40.191830 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.191807 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1b1830-0d37-4b03-a35b-d216023d5bfe-kube-api-access-jrmbc" (OuterVolumeSpecName: "kube-api-access-jrmbc") pod "9a1b1830-0d37-4b03-a35b-d216023d5bfe" (UID: "9a1b1830-0d37-4b03-a35b-d216023d5bfe"). InnerVolumeSpecName "kube-api-access-jrmbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:40.289805 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.289775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-blbcq_must-gather-lmw8p_9a1b1830-0d37-4b03-a35b-d216023d5bfe/copy/0.log" Jul 06 21:00:40.290076 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.290051 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a1b1830-0d37-4b03-a35b-d216023d5bfe-must-gather-output\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 21:00:40.290149 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.290079 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrmbc\" (UniqueName: \"kubernetes.io/projected/9a1b1830-0d37-4b03-a35b-d216023d5bfe-kube-api-access-jrmbc\") on node \"ip-10-0-130-92.ec2.internal\" DevicePath \"\"" Jul 06 21:00:40.290186 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.290140 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerID="a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229" exitCode=143 Jul 06 21:00:40.290186 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.290181 2578 scope.go:117] "RemoveContainer" containerID="a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229" Jul 06 21:00:40.290251 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.290187 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:40.293074 ip-10-0-130-92 kubenswrapper[2578]: E0706 21:00:40.293040 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lmw8p\" is forbidden: User \"system:node:ip-10-0-130-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-blbcq\": no relationship found between node 'ip-10-0-130-92.ec2.internal' and this object" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:40.297910 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.297893 2578 scope.go:117] "RemoveContainer" containerID="d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3" Jul 06 21:00:40.304270 ip-10-0-130-92 kubenswrapper[2578]: E0706 21:00:40.304246 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lmw8p\" is forbidden: User \"system:node:ip-10-0-130-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-blbcq\": no relationship found between node 'ip-10-0-130-92.ec2.internal' and this object" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" pod="openshift-must-gather-blbcq/must-gather-lmw8p" Jul 06 21:00:40.310077 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.310062 2578 scope.go:117] "RemoveContainer" containerID="a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229" Jul 06 21:00:40.310303 ip-10-0-130-92 kubenswrapper[2578]: E0706 21:00:40.310284 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229\": container with ID starting with a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229 not found: ID does not exist" containerID="a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229" Jul 06 21:00:40.310380 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.310315 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229"} err="failed to get container status \"a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229\": rpc error: code = NotFound desc = could not find container \"a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229\": container with ID starting with a8c74799b8daf1348ce5f0af94e59deafd95265a1f29b93c159b5df15588d229 not found: ID does not exist" Jul 06 21:00:40.310380 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.310339 2578 scope.go:117] "RemoveContainer" containerID="d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3" Jul 06 21:00:40.310584 ip-10-0-130-92 kubenswrapper[2578]: E0706 21:00:40.310567 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3\": container with ID starting with d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3 not found: ID does not exist" containerID="d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3" Jul 06 21:00:40.310637 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:40.310590 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3"} err="failed to get container status \"d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3\": rpc error: code = NotFound desc = could not find container \"d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3\": container with ID starting with d7d1dc482ec2fd3400fd779eace124bef4909ecc6dfeb6ea2ba2e14b512372f3 not found: ID does not exist" Jul 06 21:00:41.651489 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:41.651458 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" path="/var/lib/kubelet/pods/9a1b1830-0d37-4b03-a35b-d216023d5bfe/volumes" Jul 06 21:00:42.046694 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.046664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/alertmanager/0.log" Jul 06 21:00:42.086995 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.086956 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/config-reloader/0.log" Jul 06 21:00:42.122981 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.122952 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/kube-rbac-proxy-web/0.log" Jul 06 21:00:42.160526 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.160498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/kube-rbac-proxy/0.log" Jul 06 21:00:42.196370 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.196334 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/kube-rbac-proxy-metric/0.log" Jul 06 21:00:42.224652 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.224619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/prom-label-proxy/0.log" Jul 06 21:00:42.258346 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.258293 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e9d2898-542b-445c-8a79-c524e3dd06ff/init-config-reloader/0.log" Jul 06 21:00:42.472299 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.472214 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-555944bbd6-wjn7j_30fd034e-4916-40e1-843c-89bf1f1406a6/metrics-server/0.log" Jul 06 21:00:42.554058 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.554022 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8rvq_b9a3a815-9c6b-49f1-9a78-b08adfbad65d/node-exporter/0.log" Jul 06 21:00:42.589679 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.589640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8rvq_b9a3a815-9c6b-49f1-9a78-b08adfbad65d/kube-rbac-proxy/0.log" Jul 06 21:00:42.631202 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.631168 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8rvq_b9a3a815-9c6b-49f1-9a78-b08adfbad65d/init-textfile/0.log" Jul 06 21:00:42.871774 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.871746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-82gmv_5d287392-ad49-4066-a4d5-b7cb1d6a1301/kube-rbac-proxy-main/0.log" Jul 06 21:00:42.900190 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.900162 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-82gmv_5d287392-ad49-4066-a4d5-b7cb1d6a1301/kube-rbac-proxy-self/0.log" Jul 06 21:00:42.929527 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.929502 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-82gmv_5d287392-ad49-4066-a4d5-b7cb1d6a1301/openshift-state-metrics/0.log" Jul 06 21:00:42.980292 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:42.980262 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/prometheus/0.log" Jul 06 21:00:43.005849 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.005811 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/config-reloader/0.log" Jul 06 21:00:43.033362 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.033333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/thanos-sidecar/0.log" Jul 06 21:00:43.063499 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.063474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/kube-rbac-proxy-web/0.log" Jul 06 21:00:43.093169 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.093128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/kube-rbac-proxy/0.log" Jul 06 21:00:43.132675 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.132652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/kube-rbac-proxy-thanos/0.log" Jul 06 21:00:43.168094 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.168060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4df98d8-011d-436a-ba0d-a715983d063f/init-config-reloader/0.log" Jul 06 21:00:43.205063 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.205036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-whcnz_fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b/prometheus-operator/0.log" Jul 06 21:00:43.231064 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.231027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-whcnz_fccb5ad5-9cf7-45aa-b17c-ac46ea9cc79b/kube-rbac-proxy/0.log" Jul 06 21:00:43.315913 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.315880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56b95fbb4c-qpmxk_37747521-9d09-4073-a3c7-0a84e32a6410/telemeter-client/0.log" Jul 06 21:00:43.354805 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.354769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56b95fbb4c-qpmxk_37747521-9d09-4073-a3c7-0a84e32a6410/reload/0.log" Jul 06 21:00:43.382716 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.382617 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56b95fbb4c-qpmxk_37747521-9d09-4073-a3c7-0a84e32a6410/kube-rbac-proxy/0.log" Jul 06 21:00:43.423835 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.423809 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-87c9b7bb7-2z64x_5a238a13-f9dd-4a25-a1b6-ed4d3725e20c/thanos-query/0.log" Jul 06 21:00:43.451581 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.451553 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-87c9b7bb7-2z64x_5a238a13-f9dd-4a25-a1b6-ed4d3725e20c/kube-rbac-proxy-web/0.log" Jul 06 21:00:43.481347 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.481314 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-87c9b7bb7-2z64x_5a238a13-f9dd-4a25-a1b6-ed4d3725e20c/kube-rbac-proxy/0.log" Jul 06 21:00:43.510351 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.510319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-87c9b7bb7-2z64x_5a238a13-f9dd-4a25-a1b6-ed4d3725e20c/prom-label-proxy/0.log" Jul 06 21:00:43.542020 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.541989 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-87c9b7bb7-2z64x_5a238a13-f9dd-4a25-a1b6-ed4d3725e20c/kube-rbac-proxy-rules/0.log" Jul 06 21:00:43.576044 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:43.576018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-87c9b7bb7-2z64x_5a238a13-f9dd-4a25-a1b6-ed4d3725e20c/kube-rbac-proxy-metrics/0.log" Jul 06 21:00:45.759131 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:45.759098 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/1.log" Jul 06 21:00:45.766560 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:45.766514 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2fq29_8bba3a66-492f-4dd8-ad9e-7353a216c553/console-operator/2.log" Jul 06 21:00:46.028483 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028403 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht"] Jul 06 21:00:46.028776 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028763 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="gather" Jul 06 21:00:46.028818 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028778 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="gather" Jul 06 21:00:46.028818 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028788 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="copy" Jul 06 21:00:46.028818 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028793 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="copy" Jul 06 21:00:46.028909 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028845 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="copy" Jul 06 21:00:46.028909 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.028855 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1b1830-0d37-4b03-a35b-d216023d5bfe" containerName="gather" Jul 06 21:00:46.031307 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.031286 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.038999 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.038981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-lib-modules\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.039091 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.039009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-podres\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.039091 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.039041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcz4q\" (UniqueName: \"kubernetes.io/projected/c08fca70-f191-4764-ae9e-95d58c89f9c6-kube-api-access-vcz4q\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.039158 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.039102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-sys\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.039158 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.039135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-proc\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.042078 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.042062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6q7z\"/\"openshift-service-ca.crt\"" Jul 06 21:00:46.042126 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.042089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6q7z\"/\"default-dockercfg-qrp5b\"" Jul 06 21:00:46.043232 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.043215 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6q7z\"/\"kube-root-ca.crt\"" Jul 06 21:00:46.052910 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.052886 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht"] Jul 06 21:00:46.139653 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-sys\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139653 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-proc\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-lib-modules\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-podres\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-sys\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcz4q\" (UniqueName: \"kubernetes.io/projected/c08fca70-f191-4764-ae9e-95d58c89f9c6-kube-api-access-vcz4q\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-proc\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-lib-modules\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.139904 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.139870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c08fca70-f191-4764-ae9e-95d58c89f9c6-podres\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.153082 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.153057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcz4q\" (UniqueName: \"kubernetes.io/projected/c08fca70-f191-4764-ae9e-95d58c89f9c6-kube-api-access-vcz4q\") pod \"perf-node-gather-daemonset-hcfht\" (UID: \"c08fca70-f191-4764-ae9e-95d58c89f9c6\") " pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.340321 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.340225 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:46.356136 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.356109 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b4dbd86b7-vvp7d_33b674f2-2b1c-4646-b8b1-c190b65a8820/console/0.log" Jul 06 21:00:46.502562 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:46.502511 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht"] Jul 06 21:00:46.506368 ip-10-0-130-92 kubenswrapper[2578]: W0706 21:00:46.506332 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc08fca70_f191_4764_ae9e_95d58c89f9c6.slice/crio-86c61ddcb1021e764968d32393836ee93a0e1fa8789018f1900d486b600d7755 WatchSource:0}: Error finding container 86c61ddcb1021e764968d32393836ee93a0e1fa8789018f1900d486b600d7755: Status 404 returned error can't find the container with id 86c61ddcb1021e764968d32393836ee93a0e1fa8789018f1900d486b600d7755 Jul 06 21:00:47.321420 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:47.321381 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" event={"ID":"c08fca70-f191-4764-ae9e-95d58c89f9c6","Type":"ContainerStarted","Data":"2ce0f5c3cab5b4f13c06d84b4251f5561b6e08ece3a4667e6d8848285c6e2a60"} Jul 06 21:00:47.321865 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:47.321440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" event={"ID":"c08fca70-f191-4764-ae9e-95d58c89f9c6","Type":"ContainerStarted","Data":"86c61ddcb1021e764968d32393836ee93a0e1fa8789018f1900d486b600d7755"} Jul 06 21:00:47.321865 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:47.321471 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:47.354412 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:47.354355 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" podStartSLOduration=1.354338889 podStartE2EDuration="1.354338889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:47.353786531 +0000 UTC m=+1564.178090782" watchObservedRunningTime="2026-07-06 21:00:47.354338889 +0000 UTC m=+1564.178643167" Jul 06 21:00:48.254215 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:48.254158 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4h79_dc0d00a7-6446-4b57-a9b8-246bddc9000e/dns/0.log" Jul 06 21:00:48.323551 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:48.323509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4h79_dc0d00a7-6446-4b57-a9b8-246bddc9000e/kube-rbac-proxy/0.log" Jul 06 21:00:48.502915 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:48.502887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w7j9k_ee292b2f-f27c-4bfa-bdab-cabf5ddbef81/dns-node-resolver/0.log" Jul 06 21:00:49.093601 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:49.093573 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qt77r_9136d806-1d82-4d85-97a2-061188be0c8b/node-ca/0.log" Jul 06 21:00:50.634910 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:50.634873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sjhf_59edef18-394d-4f0f-a538-916ec76d5482/serve-healthcheck-canary/0.log" Jul 06 21:00:51.371614 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:51.371577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sxvrg_79c72543-2029-48e9-844a-cd17bea90ce5/kube-rbac-proxy/0.log" Jul 06 21:00:51.407218 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:51.407192 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sxvrg_79c72543-2029-48e9-844a-cd17bea90ce5/exporter/0.log" Jul 06 21:00:51.435233 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:51.435202 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sxvrg_79c72543-2029-48e9-844a-cd17bea90ce5/extractor/0.log" Jul 06 21:00:53.336109 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:53.336083 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6q7z/perf-node-gather-daemonset-hcfht" Jul 06 21:00:53.944653 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:53.944619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-pgvs9_4392d5b4-192b-470a-b410-4349dd1e8f0e/s3-init/0.log" Jul 06 21:00:53.965825 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:53.965794 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-pgvs9_4392d5b4-192b-470a-b410-4349dd1e8f0e/download-hf-model/0.log" Jul 06 21:00:58.666434 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:58.666394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-2zvx5_55e50973-3597-44ef-a697-1791feec67a3/migrator/0.log" Jul 06 21:00:58.695735 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:00:58.695706 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-2zvx5_55e50973-3597-44ef-a697-1791feec67a3/graceful-termination/0.log" Jul 06 21:01:00.657699 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.657663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/kube-multus-additional-cni-plugins/0.log" Jul 06 21:01:00.715022 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.714995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/egress-router-binary-copy/0.log" Jul 06 21:01:00.764916 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.764884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/cni-plugins/0.log" Jul 06 21:01:00.807219 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.807176 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/bond-cni-plugin/0.log" Jul 06 21:01:00.856162 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.856129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/routeoverride-cni/0.log" Jul 06 21:01:00.892674 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.892646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/whereabouts-cni-bincopy/0.log" Jul 06 21:01:00.922450 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:00.922375 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpvlw_f612ed61-569d-4c7b-9b2b-c5b60441774a/whereabouts-cni/0.log" Jul 06 21:01:01.032101 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:01.032067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wwtt5_62174162-e378-40cf-b5fb-9fc1663d7448/kube-multus/0.log" Jul 06 21:01:01.185258 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:01.185167 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qhwm8_02c1e87e-16f0-47a9-8c84-3ef8a5e889c0/network-metrics-daemon/0.log" Jul 06 21:01:01.211812 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:01.211786 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qhwm8_02c1e87e-16f0-47a9-8c84-3ef8a5e889c0/kube-rbac-proxy/0.log" Jul 06 21:01:02.065878 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.065830 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/ovn-controller/0.log" Jul 06 21:01:02.094881 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.094853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/ovn-acl-logging/0.log" Jul 06 21:01:02.131938 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.131904 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/kube-rbac-proxy-node/0.log" Jul 06 21:01:02.157677 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.157648 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 21:01:02.182426 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.182401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/northd/0.log" Jul 06 21:01:02.208542 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.208491 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/nbdb/0.log" Jul 06 21:01:02.237886 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.237855 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/sbdb/0.log" Jul 06 21:01:02.303355 ip-10-0-130-92 kubenswrapper[2578]: I0706 21:01:02.303323 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44lv8_9d126018-4b0c-4b87-889c-29c370b7977a/ovnkube-controller/0.log"