Sep 09 20:09:11.348058 ip-10-0-143-188 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 20:09:11.348072 ip-10-0-143-188 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 20:09:11.348081 ip-10-0-143-188 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 20:09:11.348394 ip-10-0-143-188 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 20:09:21.519855 ip-10-0-143-188 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 20:09:21.519874 ip-10-0-143-188 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7c19789a61de4862b2525cbb38325a55 -- Sep 09 20:11:08.341114 ip-10-0-143-188 systemd[1]: Starting Kubernetes Kubelet... Sep 09 20:11:08.781362 ip-10-0-143-188 kubenswrapper[2541]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:11:08.781362 ip-10-0-143-188 kubenswrapper[2541]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 20:11:08.781362 ip-10-0-143-188 kubenswrapper[2541]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:11:08.781362 ip-10-0-143-188 kubenswrapper[2541]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 20:11:08.781362 ip-10-0-143-188 kubenswrapper[2541]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:11:08.782491 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.782407 2541 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 20:11:08.787516 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787501 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:08.787516 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787517 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787521 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787525 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787528 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787532 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787535 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787538 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787541 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787544 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787547 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787549 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787552 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787555 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787557 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787560 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787562 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787565 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787567 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787570 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787573 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:08.787582 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787576 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787578 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787581 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787584 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787587 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787590 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787592 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787597 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787601 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787604 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787607 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787610 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787614 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787617 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787621 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787623 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787626 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787629 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787631 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:08.788111 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787634 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787636 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787639 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787641 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787644 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787646 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787649 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787651 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787654 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787656 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787659 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787661 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787663 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787666 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787668 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787672 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787675 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787677 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787680 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787683 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:08.788709 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787685 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787688 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787690 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787694 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787698 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787701 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787704 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787707 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787710 2541 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787712 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787715 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787717 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787719 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787722 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787724 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787727 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787729 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787732 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787734 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787737 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:08.789358 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787740 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787742 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787745 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787748 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787750 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787753 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787755 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787758 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787761 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787764 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787768 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787771 2541 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787774 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787777 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787780 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787783 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787785 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787800 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:08.789862 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.787803 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:08.791653 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791637 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:08.791653 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791653 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791658 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791661 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791664 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791667 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791670 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791672 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791675 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791678 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791680 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791683 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791686 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791688 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791691 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791694 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791696 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791699 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791703 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791706 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791710 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:08.791732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791712 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791715 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791718 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791720 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791723 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791725 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791728 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791730 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791733 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791735 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791739 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791742 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791745 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791749 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791751 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791754 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791757 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791759 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791761 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791764 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:08.792242 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791766 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791769 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791771 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791774 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791776 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791779 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791781 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791783 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791786 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791804 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791807 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791810 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791813 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791815 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791819 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791822 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791824 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791827 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791829 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:08.792734 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791833 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791837 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791840 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791843 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791846 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791848 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791851 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791854 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791858 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791862 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791865 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791867 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791870 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791873 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791875 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791878 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791881 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791883 2541 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791885 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791888 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:08.793212 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791891 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791893 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791896 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791899 2541 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791902 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791904 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791908 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791910 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791913 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791915 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791918 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791920 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791923 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791925 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791928 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791930 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791933 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791935 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.791938 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792281 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:08.793719 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792286 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792288 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792291 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792294 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792297 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792299 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792302 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792304 2541 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792307 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792310 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792312 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792315 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792318 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792320 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792323 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792326 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792329 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792331 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792334 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792336 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:08.794230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792339 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792341 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792344 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792346 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792349 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792351 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792355 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792359 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792362 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792364 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792367 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792370 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792373 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792375 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792377 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792380 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792382 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792385 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792387 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:08.794702 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792390 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792393 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792395 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792397 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792402 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792405 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792407 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792409 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792412 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792415 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792417 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792420 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792422 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792425 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792427 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792430 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792432 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792435 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792437 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792439 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:08.795163 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792442 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792444 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792447 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792449 2541 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792451 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792454 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792456 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792458 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792461 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792463 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792466 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792468 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792470 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792473 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792475 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792478 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792482 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792484 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792487 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:08.795633 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792490 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792493 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792497 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792500 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792504 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792509 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792511 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792514 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792517 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792519 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792522 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792524 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792527 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792529 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792532 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792534 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792537 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792539 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792541 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:08.796106 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.792544 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792609 2541 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792641 2541 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792646 2541 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792653 2541 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792657 2541 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792660 2541 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792673 2541 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792677 2541 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792680 2541 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792684 2541 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792687 2541 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792690 2541 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792693 2541 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792696 2541 flags.go:64] FLAG: --cgroup-root="" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792699 2541 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792701 2541 flags.go:64] FLAG: --client-ca-file="" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792706 2541 flags.go:64] FLAG: --cloud-provider="external" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792709 2541 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792713 2541 flags.go:64] FLAG: --cluster-domain="" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792715 2541 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792719 2541 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792722 2541 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792725 2541 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 20:11:08.796562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792728 2541 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792731 2541 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792734 2541 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792737 2541 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792740 2541 flags.go:64] FLAG: --contention-profiling="false" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792743 2541 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792745 2541 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792749 2541 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792752 2541 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792761 2541 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792764 2541 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792766 2541 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792769 2541 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792772 2541 flags.go:64] FLAG: --enable-server="true" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792774 2541 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792778 2541 flags.go:64] FLAG: --event-burst="100" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792781 2541 flags.go:64] FLAG: --event-qps="50" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792783 2541 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792787 2541 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792807 2541 flags.go:64] FLAG: --eviction-hard="" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792813 2541 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792817 2541 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792821 2541 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792826 2541 flags.go:64] FLAG: --eviction-soft="" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792829 2541 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 20:11:08.797147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792833 2541 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792838 2541 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792841 2541 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792844 2541 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792846 2541 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792849 2541 flags.go:64] FLAG: --feature-gates="" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792853 2541 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792855 2541 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792858 2541 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792861 2541 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792864 2541 flags.go:64] FLAG: --healthz-port="10248" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792867 2541 flags.go:64] FLAG: --help="false" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792870 2541 flags.go:64] FLAG: --hostname-override="ip-10-0-143-188.ec2.internal" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792872 2541 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792875 2541 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792878 2541 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792881 2541 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792884 2541 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792887 2541 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792890 2541 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792892 2541 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792895 2541 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792898 2541 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792901 2541 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 20:11:08.797782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792903 2541 flags.go:64] FLAG: --kube-reserved="" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792906 2541 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792909 2541 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792912 2541 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792915 2541 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792917 2541 flags.go:64] FLAG: --lock-file="" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792920 2541 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792923 2541 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792927 2541 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792932 2541 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792935 2541 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792937 2541 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792940 2541 flags.go:64] FLAG: --logging-format="text" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792943 2541 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792946 2541 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792949 2541 flags.go:64] FLAG: --manifest-url="" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792951 2541 flags.go:64] FLAG: --manifest-url-header="" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792955 2541 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792959 2541 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792962 2541 flags.go:64] FLAG: --max-pods="110" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792965 2541 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792968 2541 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792971 2541 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792974 2541 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792976 2541 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 20:11:08.798382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792979 2541 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792982 2541 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792989 2541 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792992 2541 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792995 2541 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.792998 2541 flags.go:64] FLAG: --pod-cidr="" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793001 2541 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793006 2541 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793009 2541 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793011 2541 flags.go:64] FLAG: --pods-per-core="0" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793014 2541 flags.go:64] FLAG: --port="10250" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793017 2541 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793020 2541 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc434380481db4e5" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793023 2541 flags.go:64] FLAG: --qos-reserved="" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793026 2541 flags.go:64] FLAG: --read-only-port="10255" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793029 2541 flags.go:64] FLAG: --register-node="true" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793032 2541 flags.go:64] FLAG: --register-with-taints="" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793035 2541 flags.go:64] FLAG: --registry-burst="10" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793039 2541 flags.go:64] FLAG: --registry-qps="5" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793042 2541 flags.go:64] FLAG: --reserved-cpus="" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793044 2541 flags.go:64] FLAG: --reserved-memory="" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793048 2541 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793051 2541 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793053 2541 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793056 2541 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 20:11:08.799005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793059 2541 flags.go:64] FLAG: --runonce="false" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793062 2541 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793065 2541 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793068 2541 flags.go:64] FLAG: --seccomp-default="false" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793070 2541 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793073 2541 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793076 2541 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793079 2541 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793082 2541 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793085 2541 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793087 2541 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793090 2541 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793093 2541 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793096 2541 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793098 2541 flags.go:64] FLAG: --system-cgroups="" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793101 2541 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793106 2541 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793109 2541 flags.go:64] FLAG: --tls-cert-file="" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793111 2541 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793116 2541 flags.go:64] FLAG: --tls-min-version="" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793119 2541 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793121 2541 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793124 2541 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793128 2541 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793131 2541 flags.go:64] FLAG: --v="2" Sep 09 20:11:08.799598 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793135 2541 flags.go:64] FLAG: --version="false" Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793139 2541 flags.go:64] FLAG: --vmodule="" Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793142 2541 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.793145 2541 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793253 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793256 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793259 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793263 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793265 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793268 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793271 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793273 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793276 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793279 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793281 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793284 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793286 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793289 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793291 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793294 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793296 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:08.800222 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793299 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793301 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793304 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793306 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793309 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793313 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793316 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793319 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793322 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793328 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793331 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793333 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793336 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793341 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793344 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793346 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793349 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793351 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793355 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:08.800774 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793358 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793360 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793363 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793365 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793368 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793370 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793373 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793375 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793377 2541 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793380 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793382 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793385 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793387 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793390 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793392 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793396 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793399 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793402 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793405 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:08.801265 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793407 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793409 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793412 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793415 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793418 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793420 2541 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793423 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793425 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793428 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793431 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793433 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793436 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793439 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793442 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793444 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793446 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793449 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793451 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793454 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793456 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:08.801713 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793458 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793461 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793463 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793466 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793468 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793470 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793473 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793476 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793478 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793481 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793483 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793486 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793488 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793490 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793493 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793497 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793499 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793501 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793504 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:08.802230 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793506 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793509 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793513 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793516 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.793519 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.794256 2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.801929 2541 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.802045 2541 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.802061 2541 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.802067 2541 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802121 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802125 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802129 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802132 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802134 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:08.802705 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802137 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802140 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802142 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802145 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802148 2541 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802150 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802153 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802155 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802158 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802160 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802163 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802166 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802169 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802172 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802174 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802176 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802179 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802181 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802183 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802186 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:08.803136 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802188 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802192 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802195 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802198 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802203 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802206 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802209 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802212 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802214 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802217 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802220 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802222 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802225 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802227 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802230 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802233 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802236 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802239 2541 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802241 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:08.803609 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802244 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802247 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802249 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802251 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802254 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802256 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802259 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802261 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802264 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802266 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802268 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802271 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802273 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802276 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802278 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802281 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802283 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802286 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802290 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802292 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:08.804087 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802295 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802297 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802301 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802304 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802307 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802310 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802312 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802316 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802318 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802321 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802323 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802326 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802328 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802330 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802333 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802335 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802337 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802340 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802342 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:08.804571 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802345 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802347 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802350 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802352 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802355 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802357 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802359 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802362 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802365 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802367 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802370 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802372 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802375 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802378 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802381 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:08.805085 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802384 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.802388 2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802489 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802493 2541 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802496 2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802499 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802502 2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802505 2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802508 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802510 2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802513 2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802515 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802518 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802520 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802523 2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:08.805458 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802525 2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802528 2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802530 2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802532 2541 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802535 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802538 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802540 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802543 2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802545 2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802548 2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802550 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802553 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802555 2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802558 2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802560 2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802563 2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802566 2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802569 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802571 2541 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802574 2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:08.805872 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802576 2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802579 2541 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802581 2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802583 2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802586 2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802588 2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802591 2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802593 2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802597 2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802600 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802603 2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802605 2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802608 2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802611 2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802614 2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802616 2541 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802619 2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802622 2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802624 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:08.806364 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802626 2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802629 2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802631 2541 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802634 2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802638 2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802641 2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802643 2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802646 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802649 2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802653 2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802656 2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802659 2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802662 2541 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802664 2541 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802670 2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802672 2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802675 2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802677 2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802680 2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:08.806829 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802682 2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802684 2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802687 2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802690 2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802692 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802694 2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802697 2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802699 2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802702 2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802704 2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802707 2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802709 2541 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802712 2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802715 2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802718 2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802720 2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802722 2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802725 2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802727 2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802730 2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:08.807315 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802732 2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802735 2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802737 2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802740 2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802742 2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802745 2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802747 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:08.802751 2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.802755 2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.802864 2541 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.804568 2541 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.805645 2541 server.go:1019] "Starting client certificate rotation" Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.805744 2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:11:08.807779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.805818 2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:11:08.809336 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.809323 2541 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:11:08.812413 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.812393 2541 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:11:08.823290 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.823272 2541 log.go:25] "Validated CRI v1 runtime API" Sep 09 20:11:08.826621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.826603 2541 log.go:25] "Validated CRI v1 image API" Sep 09 20:11:08.827469 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.827442 2541 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 20:11:08.831762 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.831742 2541 fs.go:135] Filesystem UUIDs: map[2c9cb394-1144-44e6-88f7-4d8368fbf0e9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e1f4a8fc-457b-45de-98a9-3a9758761c79:/dev/nvme0n1p3] Sep 09 20:11:08.831853 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.831760 2541 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 20:11:08.837603 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.837497 2541 manager.go:216] Machine: {Timestamp:2026-09-09 20:11:08.835158638 +0000 UTC m=+0.367476613 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100336 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec235f776d5d2a0e9a8d1104bf3d7303 SystemUUID:ec235f77-6d5d-2a0e-9a8d-1104bf3d7303 BootID:7c19789a-61de-4862-b252-5cbb38325a55 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:a3:8b:d9:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:a3:8b:d9:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:a5:f0:67:c6:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 20:11:08.837603 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.837595 2541 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 20:11:08.837735 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.837681 2541 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 20:11:08.839150 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.839133 2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:11:08.841109 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.841080 2541 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 20:11:08.841227 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.841111 2541 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 20:11:08.841956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.841946 2541 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 20:11:08.841989 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.841958 2541 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 20:11:08.841989 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.841965 2541 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:11:08.842838 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.842828 2541 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:11:08.844092 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.844083 2541 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 20:11:08.848700 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848689 2541 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:11:08.848814 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848804 2541 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 20:11:08.848846 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848831 2541 kubelet.go:486] "Attempting to sync node with API server" Sep 09 20:11:08.848846 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848845 2541 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 20:11:08.848895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848858 2541 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 20:11:08.848895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848866 2541 kubelet.go:398] "Adding apiserver pod source" Sep 09 20:11:08.848895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.848874 2541 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 20:11:08.849158 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.849142 2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:11:08.849158 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.849161 2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:11:08.851486 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.851468 2541 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 20:11:08.854318 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.854304 2541 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 20:11:08.854386 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.854334 2541 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 20:11:08.855164 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855152 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 20:11:08.855200 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855169 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 20:11:08.855200 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855175 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 20:11:08.855200 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855180 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 20:11:08.855200 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855189 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 20:11:08.855200 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855194 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 20:11:08.855331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855207 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 20:11:08.855331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855212 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 20:11:08.855331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855218 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 20:11:08.855331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855223 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 20:11:08.855331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855236 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 20:11:08.855331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.855241 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 20:11:08.856079 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.856069 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 20:11:08.856079 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.856079 2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 20:11:08.859252 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.859223 2541 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 20:11:08.859333 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.859254 2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 20:11:08.859333 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.859302 2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 20:11:08.860140 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.860126 2541 server.go:1268] "Started kubelet" Sep 09 20:11:08.860200 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.860180 2541 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 20:11:08.860335 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.860287 2541 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 20:11:08.860416 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.860346 2541 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 20:11:08.860740 ip-10-0-143-188 systemd[1]: Started Kubernetes Kubelet. Sep 09 20:11:08.861891 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.861872 2541 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 20:11:08.862128 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.862116 2541 server.go:310] "Adding debug handlers to kubelet server" Sep 09 20:11:08.865373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.865344 2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8qpmt" Sep 09 20:11:08.866869 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.866849 2541 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 20:11:08.867651 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.866470 2541 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-188.ec2.internal.18d3c013f0069967 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-188.ec2.internal,UID:ip-10-0-143-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-188.ec2.internal,},FirstTimestamp:2026-09-09 20:11:08.860094823 +0000 UTC m=+0.392412778,LastTimestamp:2026-09-09 20:11:08.860094823 +0000 UTC m=+0.392412778,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-188.ec2.internal,}" Sep 09 20:11:08.870436 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.870421 2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8qpmt" Sep 09 20:11:08.870729 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.870714 2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 20:11:08.871496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.871481 2541 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 20:11:08.871604 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.871582 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:08.872273 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872257 2541 factory.go:55] Registering systemd factory Sep 09 20:11:08.872363 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872276 2541 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 20:11:08.872363 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872288 2541 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 20:11:08.872363 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872300 2541 factory.go:223] Registration of the systemd container factory successfully Sep 09 20:11:08.872363 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872257 2541 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 20:11:08.872554 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872386 2541 reconstruct.go:97] "Volume reconstruction finished" Sep 09 20:11:08.872554 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872393 2541 reconciler.go:29] "Reconciler: start to sync state" Sep 09 20:11:08.872554 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872497 2541 factory.go:153] Registering CRI-O factory Sep 09 20:11:08.872554 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872508 2541 factory.go:223] Registration of the crio container factory successfully Sep 09 20:11:08.872554 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872555 2541 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 20:11:08.872858 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872572 2541 factory.go:103] Registering Raw factory Sep 09 20:11:08.872858 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.872589 2541 manager.go:1196] Started watching for new ooms in manager Sep 09 20:11:08.873195 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.873004 2541 manager.go:349] Starting recovery of all containers Sep 09 20:11:08.879755 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.879727 2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 20:11:08.881026 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.881002 2541 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 20:11:08.881118 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.881078 2541 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 20:11:08.882708 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.882689 2541 manager.go:354] Recovery completed Sep 09 20:11:08.885078 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.885061 2541 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 09 20:11:08.888047 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.888036 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:08.889776 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.889761 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:08.889919 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.889907 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:08.890002 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.889991 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:08.890526 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.890513 2541 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 20:11:08.890526 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.890525 2541 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 20:11:08.890656 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.890538 2541 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:11:08.890656 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.890544 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:08.891276 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.891263 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:08.891350 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.891297 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:08.891350 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.891316 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:08.892615 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.892603 2541 policy_none.go:49] "None policy: Start" Sep 09 20:11:08.892657 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.892618 2541 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 20:11:08.892657 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.892628 2541 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 20:11:08.894648 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.894636 2541 policy_none.go:47] "Start" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937327 2541 manager.go:337] "Starting Device Plugin manager" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.937355 2541 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937364 2541 server.go:87] "Starting device plugin registration server" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937579 2541 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937704 2541 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937807 2541 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937876 2541 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.937889 2541 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.938344 2541 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.938388 2541 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.938852 2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.938894 2541 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.938912 2541 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:08.938953 2541 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 20:11:08.949730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:08.940699 2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:09.038699 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.038645 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:09.039026 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039007 2541 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal"] Sep 09 20:11:09.039092 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039081 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:09.039509 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039494 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:09.039574 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039526 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:09.039574 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039537 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:09.039574 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039555 2541 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.039847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039831 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:09.039908 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039860 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:09.039908 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.039873 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:09.041962 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.041950 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:09.042083 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.042068 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.042159 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.042097 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:09.043462 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.043063 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:09.043462 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.043088 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:09.043462 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.043101 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:09.043869 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.043851 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:09.043946 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.043882 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:09.043946 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.043897 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:09.046106 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.046089 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.046165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.046121 2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:09.046843 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.046826 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:09.046927 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.046850 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:09.046927 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.046859 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:09.047546 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.047533 2541 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.047590 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.047551 2541 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-188.ec2.internal\": node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.061069 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.061052 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.062324 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.062308 2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-188.ec2.internal\" not found" node="ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.066770 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.066753 2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-188.ec2.internal\" not found" node="ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.161266 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.161248 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.173805 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.173775 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4015b4d9b6d109683c3ebeeaae56b434-config\") pod \"kube-apiserver-proxy-ip-10-0-143-188.ec2.internal\" (UID: \"4015b4d9b6d109683c3ebeeaae56b434\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.173870 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.173809 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0fa861ee194a42c6c4ffebdae8d4ebf4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal\" (UID: \"0fa861ee194a42c6c4ffebdae8d4ebf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.173870 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.173829 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fa861ee194a42c6c4ffebdae8d4ebf4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal\" (UID: \"0fa861ee194a42c6c4ffebdae8d4ebf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.261863 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.261840 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.274208 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.274187 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fa861ee194a42c6c4ffebdae8d4ebf4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal\" (UID: \"0fa861ee194a42c6c4ffebdae8d4ebf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.274260 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.274212 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4015b4d9b6d109683c3ebeeaae56b434-config\") pod \"kube-apiserver-proxy-ip-10-0-143-188.ec2.internal\" (UID: \"4015b4d9b6d109683c3ebeeaae56b434\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.274260 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.274229 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0fa861ee194a42c6c4ffebdae8d4ebf4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal\" (UID: \"0fa861ee194a42c6c4ffebdae8d4ebf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.274341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.274266 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0fa861ee194a42c6c4ffebdae8d4ebf4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal\" (UID: \"0fa861ee194a42c6c4ffebdae8d4ebf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.274341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.274283 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fa861ee194a42c6c4ffebdae8d4ebf4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal\" (UID: \"0fa861ee194a42c6c4ffebdae8d4ebf4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.274341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.274317 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4015b4d9b6d109683c3ebeeaae56b434-config\") pod \"kube-apiserver-proxy-ip-10-0-143-188.ec2.internal\" (UID: \"4015b4d9b6d109683c3ebeeaae56b434\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.362661 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.362608 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.364772 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.364758 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.371217 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.371200 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" Sep 09 20:11:09.463377 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.463355 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.563850 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.563826 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.664410 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.664355 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.764810 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.764771 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.806309 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.806290 2541 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 20:11:09.806658 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.806424 2541 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:11:09.865299 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.865277 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.882426 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.882399 2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:06:09 +0000 UTC" deadline="2028-02-17 07:57:24.644510583 +0000 UTC" Sep 09 20:11:09.882426 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.882423 2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12611h46m14.762090304s" Sep 09 20:11:09.952479 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:09.952342 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa861ee194a42c6c4ffebdae8d4ebf4.slice/crio-d6ee87dbc75b4c6a7650f1d8de2f94a1898e3ba5bb516d1bef977af328a34799 WatchSource:0}: Error finding container d6ee87dbc75b4c6a7650f1d8de2f94a1898e3ba5bb516d1bef977af328a34799: Status 404 returned error can't find the container with id d6ee87dbc75b4c6a7650f1d8de2f94a1898e3ba5bb516d1bef977af328a34799 Sep 09 20:11:09.959134 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.959111 2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:11:09.965820 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:09.965805 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:09.970856 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:09.970843 2541 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:10.066896 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:10.066871 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:10.167451 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:10.167428 2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-188.ec2.internal\" not found" Sep 09 20:11:10.184636 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.184617 2541 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:10.271938 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.271880 2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" Sep 09 20:11:10.282588 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.282572 2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:11:10.284837 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.284823 2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" Sep 09 20:11:10.291812 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.291782 2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:11:10.306721 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.306705 2541 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:10.837558 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.837530 2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:10.850114 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.849901 2541 apiserver.go:52] "Watching apiserver" Sep 09 20:11:10.859641 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.859611 2541 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 20:11:10.860540 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.860510 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-q4wf6","openshift-network-diagnostics/network-check-target-89nn6","openshift-ovn-kubernetes/ovnkube-node-2c279","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs","openshift-image-registry/node-ca-md7hk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal","openshift-multus/multus-additional-cni-plugins-q9xlx","openshift-multus/network-metrics-daemon-62rbr","openshift-network-operator/iptables-alerter-7nzcm","kube-system/global-pull-secret-syncer-6gtgl","kube-system/konnectivity-agent-j9558","kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xrbjv","openshift-dns/node-resolver-4dnkr"] Sep 09 20:11:10.864127 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.863472 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.866001 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.865675 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.866422 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.866398 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 20:11:10.866422 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.866410 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 20:11:10.866422 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.866419 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 20:11:10.866619 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.866438 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.866619 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.866407 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.866710 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.866629 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jqtj\"" Sep 09 20:11:10.867832 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.867809 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.868921 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.868900 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.869092 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.869079 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-45hvc\"" Sep 09 20:11:10.869395 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.869380 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.871509 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.871481 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.871614 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.871516 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.871691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.871673 2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 20:11:10.871899 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.871882 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 20:11:10.872201 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.872186 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 20:11:10.873411 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.873392 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 20:11:10.873507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.873399 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 20:11:10.873507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.873422 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.873507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.873400 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-87ssb\"" Sep 09 20:11:10.874681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.874295 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.874681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.874450 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.875144 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.874822 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 20:11:10.875144 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.874842 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.875144 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.874963 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ckcc6\"" Sep 09 20:11:10.876728 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.876708 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tzbxf\"" Sep 09 20:11:10.876852 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.876729 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.877715 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.877049 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:10.877715 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.877281 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.877715 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.877576 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 20:11:10.879626 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.879603 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.880331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.879759 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tbs67\"" Sep 09 20:11:10.880331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.879887 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.880331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.880138 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.882638 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.882756 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.882910 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883027 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-kubernetes\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883067 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysctl-conf\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883097 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-systemd\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883123 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-var-lib-kubelet\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883180 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-host\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883203 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbd6ab51-08b8-4c07-9800-6c70d304c714-tmp\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883226 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-log-socket\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883231 2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883251 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-env-overrides\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883226 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883348 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-modprobe-d\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883396 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-systemd-units\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883433 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-node-log\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883465 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-cni-netd\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883506 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.883733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883541 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5lt\" (UniqueName: \"kubernetes.io/projected/b8dda626-2349-4629-bbf2-485ca55a1102-kube-api-access-6c5lt\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883567 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883610 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-socket-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883662 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883671 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wlx9f\"" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883687 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-run-netns\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883735 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8dda626-2349-4629-bbf2-485ca55a1102-ovn-node-metrics-cert\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883758 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-etc-selinux\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883831 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-sys-fs\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883863 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94stn\" (UniqueName: \"kubernetes.io/projected/f1c4b62d-3bae-47de-9a3f-0563d369a76a-kube-api-access-94stn\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883924 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-cnibin\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883949 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-kubelet\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883972 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-slash\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.883996 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-systemd\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884039 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-ovn\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884066 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-registration-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.884679 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884104 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-device-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884138 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv9sb\" (UniqueName: \"kubernetes.io/projected/6912f6b4-9bd7-4511-8375-58364bea40ce-kube-api-access-gv9sb\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884195 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysctl-d\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884233 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-sys\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884266 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-var-lib-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884293 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-cni-bin\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884317 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1c4b62d-3bae-47de-9a3f-0563d369a76a-host\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884354 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884385 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysconfig\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884428 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-run\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884461 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884486 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-ovnkube-script-lib\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884510 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f75s8\" (UniqueName: \"kubernetes.io/projected/bbb4b0a1-de8a-400c-b78d-e34224be1d52-kube-api-access-f75s8\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884542 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884579 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-lib-modules\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884633 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-tuned\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.885495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884667 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82z29\" (UniqueName: \"kubernetes.io/projected/bbd6ab51-08b8-4c07-9800-6c70d304c714-kube-api-access-82z29\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884691 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-run-ovn-kubernetes\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884728 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-ovnkube-config\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884752 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1c4b62d-3bae-47de-9a3f-0563d369a76a-serviceca\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884803 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-system-cni-dir\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884854 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.884893 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-etc-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.885744 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 20:11:10.886279 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.885800 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-67rzl\"" Sep 09 20:11:10.886745 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.886617 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:10.886796 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:10.886764 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:10.890265 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.890241 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:10.890363 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:10.890323 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:10.893362 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.893337 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:10.895938 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.895916 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 20:11:10.896099 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.896075 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:10.896172 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.896083 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 20:11:10.896232 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:10.896208 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:10.896516 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.896495 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nkpvf\"" Sep 09 20:11:10.906987 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.906966 2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2lm65" Sep 09 20:11:10.914948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.914803 2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2lm65" Sep 09 20:11:10.943067 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.943030 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" event={"ID":"0fa861ee194a42c6c4ffebdae8d4ebf4","Type":"ContainerStarted","Data":"d6ee87dbc75b4c6a7650f1d8de2f94a1898e3ba5bb516d1bef977af328a34799"} Sep 09 20:11:10.944287 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.944264 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" event={"ID":"4015b4d9b6d109683c3ebeeaae56b434","Type":"ContainerStarted","Data":"7afb40308aaea5a8dedebb8dc965ab5b4575ebcb2767a02a09e12335a552a2a8"} Sep 09 20:11:10.973731 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.973711 2541 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 20:11:10.985922 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.985895 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v9jx\" (UniqueName: \"kubernetes.io/projected/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-kube-api-access-4v9jx\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:10.986030 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.985932 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-cni-bin\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.986030 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.985950 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-multus-certs\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.986030 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.985981 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-slash\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986030 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986017 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-systemd\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986061 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-device-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986071 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-systemd\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986091 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986116 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-cni-multus\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986140 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-daemon-config\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986139 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-slash\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986164 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv9sb\" (UniqueName: \"kubernetes.io/projected/6912f6b4-9bd7-4511-8375-58364bea40ce-kube-api-access-gv9sb\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986192 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-sys\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986210 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-var-lib-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986233 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-device-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986240 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-cni-bin\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986287 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-cni-bin\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986299 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-sys\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986305 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-var-lib-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986411 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986475 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-run\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986502 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986519 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f75s8\" (UniqueName: \"kubernetes.io/projected/bbb4b0a1-de8a-400c-b78d-e34224be1d52-kube-api-access-f75s8\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986542 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-cnibin\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986562 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-hostroot\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.986604 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986589 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986615 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82z29\" (UniqueName: \"kubernetes.io/projected/bbd6ab51-08b8-4c07-9800-6c70d304c714-kube-api-access-82z29\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986641 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-run-ovn-kubernetes\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986664 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-run\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986668 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-netns\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986721 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-tmp-dir\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986757 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986787 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-etc-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986813 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysctl-conf\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986862 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-var-lib-kubelet\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986890 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-env-overrides\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986915 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986942 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-cni-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.986983 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63eff843-25c9-416e-b5b0-91c9140dd5b7-konnectivity-ca\") pod \"konnectivity-agent-j9558\" (UID: \"63eff843-25c9-416e-b5b0-91c9140dd5b7\") " pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987012 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnxvj\" (UniqueName: \"kubernetes.io/projected/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-kube-api-access-tnxvj\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987057 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-modprobe-d\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987082 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.987305 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987092 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-systemd-units\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987121 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-cni-netd\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987149 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-iptables-alerter-script\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987178 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987232 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-run-ovn-kubernetes\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987371 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987397 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-kubelet\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987423 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63eff843-25c9-416e-b5b0-91c9140dd5b7-agent-certs\") pod \"konnectivity-agent-j9558\" (UID: \"63eff843-25c9-416e-b5b0-91c9140dd5b7\") " pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987455 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987469 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-systemd-units\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987498 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8dda626-2349-4629-bbf2-485ca55a1102-ovn-node-metrics-cert\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987513 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-cni-netd\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987546 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-sys-fs\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987554 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-etc-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987553 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-modprobe-d\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987549 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-openvswitch\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987604 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-env-overrides\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.988206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987619 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94stn\" (UniqueName: \"kubernetes.io/projected/f1c4b62d-3bae-47de-9a3f-0563d369a76a-kube-api-access-94stn\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987649 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysctl-conf\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987657 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987621 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987619 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-sys-fs\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987699 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-cnibin\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987708 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-var-lib-kubelet\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987727 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-kubelet\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987744 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-ovn\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987755 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-cnibin\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987764 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-registration-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987792 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-host-slash\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987814 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-kubelet\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987834 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-run-ovn\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987844 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-kubelet-config\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987866 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-registration-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987870 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-socket-dir-parent\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.989105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987930 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysctl-d\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987955 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1c4b62d-3bae-47de-9a3f-0563d369a76a-host\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987972 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-conf-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.987989 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7gw\" (UniqueName: \"kubernetes.io/projected/f1d884e3-d206-45e3-b68a-6b625b8b1f28-kube-api-access-tz7gw\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988006 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-hosts-file\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988028 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1c4b62d-3bae-47de-9a3f-0563d369a76a-host\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988031 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysconfig\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988063 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysctl-d\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988064 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-sysconfig\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988092 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-ovnkube-script-lib\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988100 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6912f6b4-9bd7-4511-8375-58364bea40ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988114 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-system-cni-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988132 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988175 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-lib-modules\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988176 2541 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988205 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-tuned\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988242 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-ovnkube-config\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988262 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1c4b62d-3bae-47de-9a3f-0563d369a76a-serviceca\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.989974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988278 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97fd9c63-cb06-4501-bed6-1b9737f3134a-cni-binary-copy\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988293 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-k8s-cni-cncf-io\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988360 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tj6c\" (UniqueName: \"kubernetes.io/projected/97fd9c63-cb06-4501-bed6-1b9737f3134a-kube-api-access-2tj6c\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988390 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-system-cni-dir\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988416 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-lib-modules\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988421 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-kubernetes\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988472 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-kubernetes\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988514 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-systemd\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988540 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-host\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988566 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbd6ab51-08b8-4c07-9800-6c70d304c714-tmp\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988573 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-systemd\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988635 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-log-socket\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988670 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-ovnkube-script-lib\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988670 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6912f6b4-9bd7-4511-8375-58364bea40ce-system-cni-dir\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988722 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbd6ab51-08b8-4c07-9800-6c70d304c714-host\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.988810 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-log-socket\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989169 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5lt\" (UniqueName: \"kubernetes.io/projected/b8dda626-2349-4629-bbf2-485ca55a1102-kube-api-access-6c5lt\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989203 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-socket-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989229 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-node-log\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989246 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1c4b62d-3bae-47de-9a3f-0563d369a76a-serviceca\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989256 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989287 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-dbus\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989312 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-etc-kubernetes\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989337 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-run-netns\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989362 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-etc-selinux\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989377 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8dda626-2349-4629-bbf2-485ca55a1102-ovnkube-config\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989438 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-node-log\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989454 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989487 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-etc-selinux\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989491 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8dda626-2349-4629-bbf2-485ca55a1102-host-run-netns\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.991956 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.989491 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4b0a1-de8a-400c-b78d-e34224be1d52-socket-dir\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.992971 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.992829 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbd6ab51-08b8-4c07-9800-6c70d304c714-etc-tuned\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.992971 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.992892 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbd6ab51-08b8-4c07-9800-6c70d304c714-tmp\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.992971 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.992955 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8dda626-2349-4629-bbf2-485ca55a1102-ovn-node-metrics-cert\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:10.995412 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.995388 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv9sb\" (UniqueName: \"kubernetes.io/projected/6912f6b4-9bd7-4511-8375-58364bea40ce-kube-api-access-gv9sb\") pod \"multus-additional-cni-plugins-q9xlx\" (UID: \"6912f6b4-9bd7-4511-8375-58364bea40ce\") " pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:10.995690 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.995637 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82z29\" (UniqueName: \"kubernetes.io/projected/bbd6ab51-08b8-4c07-9800-6c70d304c714-kube-api-access-82z29\") pod \"tuned-xrbjv\" (UID: \"bbd6ab51-08b8-4c07-9800-6c70d304c714\") " pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:10.996069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.996038 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f75s8\" (UniqueName: \"kubernetes.io/projected/bbb4b0a1-de8a-400c-b78d-e34224be1d52-kube-api-access-f75s8\") pod \"aws-ebs-csi-driver-node-2z4hs\" (UID: \"bbb4b0a1-de8a-400c-b78d-e34224be1d52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:10.996156 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.996038 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94stn\" (UniqueName: \"kubernetes.io/projected/f1c4b62d-3bae-47de-9a3f-0563d369a76a-kube-api-access-94stn\") pod \"node-ca-md7hk\" (UID: \"f1c4b62d-3bae-47de-9a3f-0563d369a76a\") " pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:10.997116 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:10.997094 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5lt\" (UniqueName: \"kubernetes.io/projected/b8dda626-2349-4629-bbf2-485ca55a1102-kube-api-access-6c5lt\") pod \"ovnkube-node-2c279\" (UID: \"b8dda626-2349-4629-bbf2-485ca55a1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:11.090687 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090607 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-cnibin\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.090687 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090644 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-hostroot\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.090687 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090662 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-netns\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.090687 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090687 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-tmp-dir\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090716 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-cni-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090739 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-cnibin\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090757 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-netns\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090742 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-hostroot\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090842 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63eff843-25c9-416e-b5b0-91c9140dd5b7-konnectivity-ca\") pod \"konnectivity-agent-j9558\" (UID: \"63eff843-25c9-416e-b5b0-91c9140dd5b7\") " pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090880 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-cni-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091049 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-tmp-dir\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.091069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.090878 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnxvj\" (UniqueName: \"kubernetes.io/projected/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-kube-api-access-tnxvj\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091111 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-iptables-alerter-script\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091142 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-kubelet\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091166 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63eff843-25c9-416e-b5b0-91c9140dd5b7-agent-certs\") pod \"konnectivity-agent-j9558\" (UID: \"63eff843-25c9-416e-b5b0-91c9140dd5b7\") " pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091185 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091208 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-host-slash\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091223 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-kubelet-config\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091240 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-socket-dir-parent\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091257 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-conf-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091273 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7gw\" (UniqueName: \"kubernetes.io/projected/f1d884e3-d206-45e3-b68a-6b625b8b1f28-kube-api-access-tz7gw\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091290 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-hosts-file\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091307 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-system-cni-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091324 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091342 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63eff843-25c9-416e-b5b0-91c9140dd5b7-konnectivity-ca\") pod \"konnectivity-agent-j9558\" (UID: \"63eff843-25c9-416e-b5b0-91c9140dd5b7\") " pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091348 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97fd9c63-cb06-4501-bed6-1b9737f3134a-cni-binary-copy\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091368 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-k8s-cni-cncf-io\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091384 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tj6c\" (UniqueName: \"kubernetes.io/projected/97fd9c63-cb06-4501-bed6-1b9737f3134a-kube-api-access-2tj6c\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.091476 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091406 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-dbus\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091425 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-etc-kubernetes\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091424 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-socket-dir-parent\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091451 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v9jx\" (UniqueName: \"kubernetes.io/projected/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-kube-api-access-4v9jx\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091469 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-cni-bin\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091486 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-multus-certs\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091504 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091519 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-cni-multus\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091541 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-daemon-config\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.091819 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.091913 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:11.591875498 +0000 UTC m=+3.124193462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091911 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-kubelet\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091927 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-iptables-alerter-script\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.091999 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-kubelet-config\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092034 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-dbus\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092105 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-conf-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092115 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97fd9c63-cb06-4501-bed6-1b9737f3134a-multus-daemon-config\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092266 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092154 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-etc-kubernetes\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092167 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-multus-certs\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092215 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-cni-bin\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092287 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-var-lib-cni-multus\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.092322 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092358 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-hosts-file\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.092377 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:11.592358227 +0000 UTC m=+3.124676189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092421 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-system-cni-dir\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092431 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97fd9c63-cb06-4501-bed6-1b9737f3134a-host-run-k8s-cni-cncf-io\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092460 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-host-slash\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.092931 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.092670 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97fd9c63-cb06-4501-bed6-1b9737f3134a-cni-binary-copy\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.094756 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.094737 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63eff843-25c9-416e-b5b0-91c9140dd5b7-agent-certs\") pod \"konnectivity-agent-j9558\" (UID: \"63eff843-25c9-416e-b5b0-91c9140dd5b7\") " pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:11.099157 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.098968 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:11.099157 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.098996 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:11.099157 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.099013 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:11.099157 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.099125 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:11.599106233 +0000 UTC m=+3.131424202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:11.101157 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.100716 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnxvj\" (UniqueName: \"kubernetes.io/projected/d0a6fa4b-86f9-48a7-a9de-f3243f01da37-kube-api-access-tnxvj\") pod \"node-resolver-4dnkr\" (UID: \"d0a6fa4b-86f9-48a7-a9de-f3243f01da37\") " pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.101157 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.100857 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v9jx\" (UniqueName: \"kubernetes.io/projected/f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3-kube-api-access-4v9jx\") pod \"iptables-alerter-7nzcm\" (UID: \"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3\") " pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.101791 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.101769 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7gw\" (UniqueName: \"kubernetes.io/projected/f1d884e3-d206-45e3-b68a-6b625b8b1f28-kube-api-access-tz7gw\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:11.104736 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.104717 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tj6c\" (UniqueName: \"kubernetes.io/projected/97fd9c63-cb06-4501-bed6-1b9737f3134a-kube-api-access-2tj6c\") pod \"multus-q4wf6\" (UID: \"97fd9c63-cb06-4501-bed6-1b9737f3134a\") " pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.179607 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.179576 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" Sep 09 20:11:11.188115 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.188084 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" Sep 09 20:11:11.198943 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.198919 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:11.204768 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.204747 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" Sep 09 20:11:11.212707 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.212689 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-md7hk" Sep 09 20:11:11.220513 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.220496 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dnkr" Sep 09 20:11:11.230312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.230294 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7nzcm" Sep 09 20:11:11.238139 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.238121 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4wf6" Sep 09 20:11:11.243971 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.243947 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:11.594363 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.594332 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:11.594567 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.594389 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:11.594567 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.594520 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:11.594567 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.594532 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:11.594739 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.594580 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:12.594562834 +0000 UTC m=+4.126880791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:11.594739 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.594599 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:12.59459017 +0000 UTC m=+4.126908134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:11.695084 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.695056 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:11.695230 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.695188 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:11.695230 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.695201 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:11.695230 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.695211 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:11.695367 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:11.695277 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:12.695243909 +0000 UTC m=+4.227561854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:11.918367 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.918278 2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:06:11 +0000 UTC" deadline="2028-05-14 16:34:19.228675282 +0000 UTC" Sep 09 20:11:11.918367 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:11.918311 2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14708h23m7.310369554s" Sep 09 20:11:12.037496 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.037470 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63eff843_25c9_416e_b5b0_91c9140dd5b7.slice/crio-9c531c07ff4fcd91b7ba7714ae49d5140f27b342415ca938187a007ddb363481 WatchSource:0}: Error finding container 9c531c07ff4fcd91b7ba7714ae49d5140f27b342415ca938187a007ddb363481: Status 404 returned error can't find the container with id 9c531c07ff4fcd91b7ba7714ae49d5140f27b342415ca938187a007ddb363481 Sep 09 20:11:12.039658 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.039617 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c4b62d_3bae_47de_9a3f_0563d369a76a.slice/crio-a5131faa801a1c94d9aa139b38b8d751d17a745bfe53af81979245fd8287ac34 WatchSource:0}: Error finding container a5131faa801a1c94d9aa139b38b8d751d17a745bfe53af81979245fd8287ac34: Status 404 returned error can't find the container with id a5131faa801a1c94d9aa139b38b8d751d17a745bfe53af81979245fd8287ac34 Sep 09 20:11:12.041683 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.041662 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb4b0a1_de8a_400c_b78d_e34224be1d52.slice/crio-1548cf8863ab31411fda2bc25a89223fccbffecbcb3199deba6b6755308887de WatchSource:0}: Error finding container 1548cf8863ab31411fda2bc25a89223fccbffecbcb3199deba6b6755308887de: Status 404 returned error can't find the container with id 1548cf8863ab31411fda2bc25a89223fccbffecbcb3199deba6b6755308887de Sep 09 20:11:12.047125 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.047102 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a6fa4b_86f9_48a7_a9de_f3243f01da37.slice/crio-8646268073f71549f595d435810af1de493167689724e1cf6ec26418efe862a3 WatchSource:0}: Error finding container 8646268073f71549f595d435810af1de493167689724e1cf6ec26418efe862a3: Status 404 returned error can't find the container with id 8646268073f71549f595d435810af1de493167689724e1cf6ec26418efe862a3 Sep 09 20:11:12.048868 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.048526 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd6ab51_08b8_4c07_9800_6c70d304c714.slice/crio-4832ee26fd2b09e7c29f73711732d8d88e319e8fe16d154c389c06fd996c2fad WatchSource:0}: Error finding container 4832ee26fd2b09e7c29f73711732d8d88e319e8fe16d154c389c06fd996c2fad: Status 404 returned error can't find the container with id 4832ee26fd2b09e7c29f73711732d8d88e319e8fe16d154c389c06fd996c2fad Sep 09 20:11:12.049450 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.049428 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fd9c63_cb06_4501_bed6_1b9737f3134a.slice/crio-995b93eb5eebedebc6c05549ebeaf489c087f2539b00834cc529915b1656e500 WatchSource:0}: Error finding container 995b93eb5eebedebc6c05549ebeaf489c087f2539b00834cc529915b1656e500: Status 404 returned error can't find the container with id 995b93eb5eebedebc6c05549ebeaf489c087f2539b00834cc529915b1656e500 Sep 09 20:11:12.051049 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.051016 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8dda626_2349_4629_bbf2_485ca55a1102.slice/crio-ca4b886de0109785ebc6a7f3e23cdd9b3dd2e4aa95699dc814690136f26797b1 WatchSource:0}: Error finding container ca4b886de0109785ebc6a7f3e23cdd9b3dd2e4aa95699dc814690136f26797b1: Status 404 returned error can't find the container with id ca4b886de0109785ebc6a7f3e23cdd9b3dd2e4aa95699dc814690136f26797b1 Sep 09 20:11:12.051427 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.051395 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b74ec4_5eda_4698_bd05_9f6d5d91c9f3.slice/crio-2961cc54664172b0e8b9d80cbfdbcc49d8dc85d550c977fceb3ed2d5abc1a2c8 WatchSource:0}: Error finding container 2961cc54664172b0e8b9d80cbfdbcc49d8dc85d550c977fceb3ed2d5abc1a2c8: Status 404 returned error can't find the container with id 2961cc54664172b0e8b9d80cbfdbcc49d8dc85d550c977fceb3ed2d5abc1a2c8 Sep 09 20:11:12.053608 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:12.053228 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6912f6b4_9bd7_4511_8375_58364bea40ce.slice/crio-bb4bcec4691c6218a75ef8755dbb7bd517d60ef240d092a8f877ee84a67946ae WatchSource:0}: Error finding container bb4bcec4691c6218a75ef8755dbb7bd517d60ef240d092a8f877ee84a67946ae: Status 404 returned error can't find the container with id bb4bcec4691c6218a75ef8755dbb7bd517d60ef240d092a8f877ee84a67946ae Sep 09 20:11:12.603163 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.602379 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:12.603163 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.602474 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:12.603163 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.602604 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:12.603163 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.602669 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:14.602650037 +0000 UTC m=+6.134967996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:12.603163 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.603081 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:12.603163 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.603132 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:14.603116606 +0000 UTC m=+6.135434572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:12.703355 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.703228 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:12.703504 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.703444 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:12.703504 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.703463 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:12.703504 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.703475 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:12.703615 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.703554 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:14.70353598 +0000 UTC m=+6.235853939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:12.919068 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.918944 2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:06:11 +0000 UTC" deadline="2028-06-26 07:12:46.313504434 +0000 UTC" Sep 09 20:11:12.919068 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.919015 2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15731h1m33.394493764s" Sep 09 20:11:12.941605 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.941573 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:12.941737 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.941702 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:12.942589 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.942189 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:12.942589 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.942300 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:12.942589 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.942367 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:12.942589 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:12.942446 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:12.980126 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.979906 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" event={"ID":"4015b4d9b6d109683c3ebeeaae56b434","Type":"ContainerStarted","Data":"0bf87f51921dd1960eea4c5276d17d6a965e1cc14861ab737c9719f3669f3de4"} Sep 09 20:11:12.987772 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.987739 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4wf6" event={"ID":"97fd9c63-cb06-4501-bed6-1b9737f3134a","Type":"ContainerStarted","Data":"995b93eb5eebedebc6c05549ebeaf489c087f2539b00834cc529915b1656e500"} Sep 09 20:11:12.993346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.993315 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"ca4b886de0109785ebc6a7f3e23cdd9b3dd2e4aa95699dc814690136f26797b1"} Sep 09 20:11:12.996326 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:12.996101 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-188.ec2.internal" podStartSLOduration=2.996082015 podStartE2EDuration="2.996082015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:12.995053467 +0000 UTC m=+4.527371436" watchObservedRunningTime="2026-09-09 20:11:12.996082015 +0000 UTC m=+4.528399984" Sep 09 20:11:13.009419 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.009358 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dnkr" event={"ID":"d0a6fa4b-86f9-48a7-a9de-f3243f01da37","Type":"ContainerStarted","Data":"8646268073f71549f595d435810af1de493167689724e1cf6ec26418efe862a3"} Sep 09 20:11:13.013826 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.013799 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" event={"ID":"bbb4b0a1-de8a-400c-b78d-e34224be1d52","Type":"ContainerStarted","Data":"1548cf8863ab31411fda2bc25a89223fccbffecbcb3199deba6b6755308887de"} Sep 09 20:11:13.033285 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.033251 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-md7hk" event={"ID":"f1c4b62d-3bae-47de-9a3f-0563d369a76a","Type":"ContainerStarted","Data":"a5131faa801a1c94d9aa139b38b8d751d17a745bfe53af81979245fd8287ac34"} Sep 09 20:11:13.044199 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.044168 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerStarted","Data":"bb4bcec4691c6218a75ef8755dbb7bd517d60ef240d092a8f877ee84a67946ae"} Sep 09 20:11:13.068222 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.067237 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7nzcm" event={"ID":"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3","Type":"ContainerStarted","Data":"2961cc54664172b0e8b9d80cbfdbcc49d8dc85d550c977fceb3ed2d5abc1a2c8"} Sep 09 20:11:13.081247 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.081218 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" event={"ID":"bbd6ab51-08b8-4c07-9800-6c70d304c714","Type":"ContainerStarted","Data":"4832ee26fd2b09e7c29f73711732d8d88e319e8fe16d154c389c06fd996c2fad"} Sep 09 20:11:13.091706 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.091678 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9558" event={"ID":"63eff843-25c9-416e-b5b0-91c9140dd5b7","Type":"ContainerStarted","Data":"9c531c07ff4fcd91b7ba7714ae49d5140f27b342415ca938187a007ddb363481"} Sep 09 20:11:13.105946 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.105633 2541 generic.go:356] "Generic (PLEG): container finished" podID="0fa861ee194a42c6c4ffebdae8d4ebf4" containerID="b0e0a0557280457eaab290108a7ae311991e54a90c4c53b3badfd7a156ead4d4" exitCode=0 Sep 09 20:11:13.105946 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:13.105669 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" event={"ID":"0fa861ee194a42c6c4ffebdae8d4ebf4","Type":"ContainerDied","Data":"b0e0a0557280457eaab290108a7ae311991e54a90c4c53b3badfd7a156ead4d4"} Sep 09 20:11:14.119131 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.118867 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" event={"ID":"0fa861ee194a42c6c4ffebdae8d4ebf4","Type":"ContainerStarted","Data":"69cc5088961c2e7d7e15187c4fd4d15690877341fc516cf02527f87e6522ec0e"} Sep 09 20:11:14.133989 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.133544 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-188.ec2.internal" podStartSLOduration=4.133526462 podStartE2EDuration="4.133526462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:14.132595953 +0000 UTC m=+5.664913918" watchObservedRunningTime="2026-09-09 20:11:14.133526462 +0000 UTC m=+5.665844429" Sep 09 20:11:14.620355 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.620324 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:14.620511 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.620379 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:14.620582 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.620510 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:14.620635 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.620569 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:18.620551451 +0000 UTC m=+10.152869407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:14.621044 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.621026 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:14.621156 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.621098 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:18.621083387 +0000 UTC m=+10.153401342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:14.721125 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.721092 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:14.721315 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.721297 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:14.721374 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.721324 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:14.721374 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.721337 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:14.721435 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.721392 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:18.721373323 +0000 UTC m=+10.253691279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:14.941186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.940883 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:14.941186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.940900 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:14.941186 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.941004 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:14.941186 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:14.941033 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:14.941186 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.941137 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:14.941551 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:14.941217 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:16.940315 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:16.939580 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:16.940315 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:16.939720 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:16.940315 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:16.940133 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:16.940315 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:16.940198 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:16.940315 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:16.940239 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:16.940315 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:16.940283 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:18.658055 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:18.658014 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:18.658468 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:18.658070 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:18.658468 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.658200 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:18.658468 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.658262 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:26.658242523 +0000 UTC m=+18.190560468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:18.658650 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.658630 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:18.658710 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.658689 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:26.658671879 +0000 UTC m=+18.190989825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:18.758688 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:18.758655 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:18.758870 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.758853 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:18.758935 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.758878 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:18.758935 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.758892 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:18.759038 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.758947 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:26.758929027 +0000 UTC m=+18.291246986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:18.954178 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:18.954096 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:18.954340 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.954209 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:18.954586 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:18.954557 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:18.954586 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:18.954574 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:18.954730 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.954662 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:18.954816 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:18.954735 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:20.942364 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:20.942332 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:20.942778 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:20.942332 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:20.942778 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:20.942345 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:20.942778 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:20.942458 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:20.942778 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:20.942556 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:20.942778 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:20.942654 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:22.940036 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:22.940018 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:22.940366 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:22.940018 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:22.940366 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:22.940105 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:22.940366 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:22.940173 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:22.940366 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:22.940171 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:22.940366 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:22.940267 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:24.939920 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:24.939886 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:24.940325 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:24.939887 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:24.940325 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:24.940024 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:24.940325 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:24.940018 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:24.940325 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:24.940111 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:24.940325 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:24.940198 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:26.717745 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:26.717706 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:26.718276 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:26.717757 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:26.718276 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.717866 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:26.718276 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.717883 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:26.718276 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.717939 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:42.71791474 +0000 UTC m=+34.250232698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:26.718276 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.717962 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:42.717949857 +0000 UTC m=+34.250267800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:26.818842 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:26.818810 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:26.819001 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.818936 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:26.819001 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.818950 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:26.819001 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.818960 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:26.819127 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.819008 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:42.818996192 +0000 UTC m=+34.351314135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:26.939346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:26.939315 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:26.939512 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:26.939316 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:26.939512 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.939412 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:26.939512 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:26.939316 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:26.939635 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.939523 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:26.939635 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:26.939581 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:28.941098 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:28.941065 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:28.941528 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:28.941162 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:28.941528 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:28.941201 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:28.941528 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:28.941200 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:28.941528 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:28.941271 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:28.941528 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:28.941349 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:30.156543 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:30.156392 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" event={"ID":"bbd6ab51-08b8-4c07-9800-6c70d304c714","Type":"ContainerStarted","Data":"4b2028513c589ccf30e343e0daa8124cc0efd0206f1608fffb5e8ace60c21c46"} Sep 09 20:11:30.940191 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:30.939868 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:30.940369 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:30.939880 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:30.940369 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:30.940215 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:30.940369 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:30.939883 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:30.940369 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:30.940299 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:30.940369 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:30.940365 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:31.160541 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.160516 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4wf6" event={"ID":"97fd9c63-cb06-4501-bed6-1b9737f3134a","Type":"ContainerStarted","Data":"a0aa246f1cdfa98707efede06907846987b72a78fac73bbe3da7994ac0318d8b"} Sep 09 20:11:31.164388 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.164368 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"e2d5926fe49572a7e95314c043e1df318199ea7caf5c9b425f9cc96cfabe2fa1"} Sep 09 20:11:31.164507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.164430 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"ec2b8290f1629de923b8d99e84421900e32e09872a54085b94fd4b09aa4a59a9"} Sep 09 20:11:31.164507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.164475 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"a971c141e3f9bc92b4c5ddfcf7669f32f3a68b1a6067b95b66b56ee7dbab7ec8"} Sep 09 20:11:31.164608 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.164526 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"cfe739bfff498a29ba4afce66687f6f131b11b07bbf7190c4fbe8223b043b5c3"} Sep 09 20:11:31.164608 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.164574 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"1d88cd8028bae82750bccdc4b4bf7b7cd288ec490f76e4b2f95f7107acb1eb26"} Sep 09 20:11:31.164704 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.164611 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"b4957053ddd0b24c4f4600e7ba42f48267d9f2abd15a695a6ca37971d1503393"} Sep 09 20:11:31.165960 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.165937 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dnkr" event={"ID":"d0a6fa4b-86f9-48a7-a9de-f3243f01da37","Type":"ContainerStarted","Data":"066557ebf0c8f904e06d27fa4c9c30c1fd2c1c76b08d68e8bfd0ad3b9c62e65a"} Sep 09 20:11:31.167697 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.167672 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" event={"ID":"bbb4b0a1-de8a-400c-b78d-e34224be1d52","Type":"ContainerStarted","Data":"14103480a1a92ece76eded6dfc9309223630a3a94ae462fc2d2d88b7155726f1"} Sep 09 20:11:31.169503 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.169470 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-md7hk" event={"ID":"f1c4b62d-3bae-47de-9a3f-0563d369a76a","Type":"ContainerStarted","Data":"25a938e8f65544720ab39b8db7f3f6daac3c775e8ab07e7ca491ce51f7c2597c"} Sep 09 20:11:31.171416 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.171390 2541 generic.go:356] "Generic (PLEG): container finished" podID="6912f6b4-9bd7-4511-8375-58364bea40ce" containerID="7a5ea70388f76416728747eef927dddb11df49657bbfed645d64a881531169a6" exitCode=0 Sep 09 20:11:31.171504 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.171475 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerDied","Data":"7a5ea70388f76416728747eef927dddb11df49657bbfed645d64a881531169a6"} Sep 09 20:11:31.174322 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.174288 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9558" event={"ID":"63eff843-25c9-416e-b5b0-91c9140dd5b7","Type":"ContainerStarted","Data":"19eceae6525218cff0597d10916beeca154db18ea504d11fc051da7ccb3f17cb"} Sep 09 20:11:31.177353 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.177309 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xrbjv" podStartSLOduration=4.217690629 podStartE2EDuration="22.177295053s" totalImagesPullingTime="17.959604424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:30.176839934 +0000 UTC m=+21.709157900" watchObservedRunningTime="2026-09-09 20:11:31.177295053 +0000 UTC m=+22.709613016" Sep 09 20:11:31.177508 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.177473 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q4wf6" podStartSLOduration=4.176750629 podStartE2EDuration="22.177466716s" totalImagesPullingTime="18.000716087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:31.176748114 +0000 UTC m=+22.709066078" watchObservedRunningTime="2026-09-09 20:11:31.177466716 +0000 UTC m=+22.709784681" Sep 09 20:11:31.195429 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.195387 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9558" podStartSLOduration=4.269750566 podStartE2EDuration="22.195376957s" totalImagesPullingTime="17.925626391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:31.194999312 +0000 UTC m=+22.727317276" watchObservedRunningTime="2026-09-09 20:11:31.195376957 +0000 UTC m=+22.727694921" Sep 09 20:11:31.229086 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.229053 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-md7hk" podStartSLOduration=4.28184906 podStartE2EDuration="22.229041021s" totalImagesPullingTime="17.947191961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:31.228882946 +0000 UTC m=+22.761200910" watchObservedRunningTime="2026-09-09 20:11:31.229041021 +0000 UTC m=+22.761358984" Sep 09 20:11:31.243249 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.243213 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4dnkr" podStartSLOduration=4.304434506 podStartE2EDuration="22.243201978s" totalImagesPullingTime="17.938767472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:31.24306876 +0000 UTC m=+22.775386725" watchObservedRunningTime="2026-09-09 20:11:31.243201978 +0000 UTC m=+22.775519941" Sep 09 20:11:31.243680 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.243665 2541 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 20:11:31.953858 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.953734 2541 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:11:31.243678421Z","UUID":"f931500f-0526-45f6-b7a5-6eab98151f17","Handler":null,"Name":"","Endpoint":""} Sep 09 20:11:31.955346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.955319 2541 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 20:11:31.955482 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:31.955360 2541 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 20:11:32.177852 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:32.177823 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" event={"ID":"bbb4b0a1-de8a-400c-b78d-e34224be1d52","Type":"ContainerStarted","Data":"702622ae6f7d81cd182be5a74a104306e6cf9f52efe92e5702c2e117d81ff219"} Sep 09 20:11:32.179615 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:32.179579 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7nzcm" event={"ID":"f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3","Type":"ContainerStarted","Data":"d204e3c7494d4507578ae64def0a97e1073cb6ca003b5636cc0ed453143ebb92"} Sep 09 20:11:32.439267 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:32.439161 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:32.939439 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:32.939402 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:32.939620 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:32.939403 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:32.939620 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:32.939527 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:32.939620 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:32.939526 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:32.939786 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:32.939632 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:32.939786 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:32.939697 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:33.186397 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:33.186357 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"7f8c56185ad192807467a51c0a82a1f4395ab158beb3eed5da4e3d5b5a0beafe"} Sep 09 20:11:33.188681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:33.188637 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" event={"ID":"bbb4b0a1-de8a-400c-b78d-e34224be1d52","Type":"ContainerStarted","Data":"44f0a3fb7b62d3f1e186378b915b8dedd925cbc0a44f7835dc18ae0a0d0f7144"} Sep 09 20:11:33.206034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:33.205989 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2z4hs" podStartSLOduration=4.4769652220000005 podStartE2EDuration="24.205976927s" totalImagesPullingTime="19.729011705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:33.205770735 +0000 UTC m=+24.738088698" watchObservedRunningTime="2026-09-09 20:11:33.205976927 +0000 UTC m=+24.738294890" Sep 09 20:11:33.206297 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:33.206266 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7nzcm" podStartSLOduration=6.257762956 podStartE2EDuration="24.206255569s" totalImagesPullingTime="17.948492613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:32.193701576 +0000 UTC m=+23.726019540" watchObservedRunningTime="2026-09-09 20:11:33.206255569 +0000 UTC m=+24.738573535" Sep 09 20:11:33.591387 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:33.591309 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:33.591974 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:33.591930 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:34.191541 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:34.191510 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9558" Sep 09 20:11:34.940373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:34.939901 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:34.940373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:34.939908 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:34.940373 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:34.940037 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:34.940373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:34.939908 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:34.940373 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:34.940077 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:34.940373 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:34.940143 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:36.198178 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.197966 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" event={"ID":"b8dda626-2349-4629-bbf2-485ca55a1102","Type":"ContainerStarted","Data":"adc7cc7ac0aa4531d34a3b7b28f4e9dc74ac2929ade0bb7148a747d80fcf5942"} Sep 09 20:11:36.198982 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.198230 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:36.198982 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.198279 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:36.198982 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.198318 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:36.200486 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.200464 2541 generic.go:356] "Generic (PLEG): container finished" podID="6912f6b4-9bd7-4511-8375-58364bea40ce" containerID="194d9d748f44bd0918f6148cf8789827f054944e8aa3bef9830fad6e009eacb9" exitCode=0 Sep 09 20:11:36.200629 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.200552 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerDied","Data":"194d9d748f44bd0918f6148cf8789827f054944e8aa3bef9830fad6e009eacb9"} Sep 09 20:11:36.214106 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.214087 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:36.214537 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.214517 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:11:36.223171 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.223136 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" podStartSLOduration=9.228853673 podStartE2EDuration="27.223124623s" totalImagesPullingTime="17.99427095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:36.221822969 +0000 UTC m=+27.754140928" watchObservedRunningTime="2026-09-09 20:11:36.223124623 +0000 UTC m=+27.755442586" Sep 09 20:11:36.939955 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.939918 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:36.940208 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.939934 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:36.940208 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:36.940072 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:36.940208 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:36.940079 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:36.940208 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:36.940187 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:36.940434 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:36.940298 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:37.232111 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:37.231901 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-89nn6"] Sep 09 20:11:37.232111 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:37.232105 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:37.232485 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:37.232174 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:37.238749 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:37.238496 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-62rbr"] Sep 09 20:11:37.238749 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:37.238600 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:37.238749 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:37.238711 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:37.239274 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:37.239250 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gtgl"] Sep 09 20:11:37.239404 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:37.239336 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:37.239468 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:37.239427 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:38.208004 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:38.207964 2541 generic.go:356] "Generic (PLEG): container finished" podID="6912f6b4-9bd7-4511-8375-58364bea40ce" containerID="aee57f971ad48183bf40fb24355954335d2e205d509f75addddaca7a36c15f05" exitCode=0 Sep 09 20:11:38.208195 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:38.208044 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerDied","Data":"aee57f971ad48183bf40fb24355954335d2e205d509f75addddaca7a36c15f05"} Sep 09 20:11:38.940959 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:38.940933 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:38.941258 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:38.941041 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:38.941258 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:38.941138 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:38.941258 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:38.941174 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:38.941258 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:38.941226 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:38.941258 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:38.941037 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:39.213030 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:39.213002 2541 generic.go:356] "Generic (PLEG): container finished" podID="6912f6b4-9bd7-4511-8375-58364bea40ce" containerID="bf496d24d60195c6b711d07e1efebd204d611ca071cb34561be06d233314c2d7" exitCode=0 Sep 09 20:11:39.213126 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:39.213062 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerDied","Data":"bf496d24d60195c6b711d07e1efebd204d611ca071cb34561be06d233314c2d7"} Sep 09 20:11:40.940450 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:40.940218 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:40.940915 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:40.940222 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:40.940915 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:40.940555 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-62rbr" podUID="f1d884e3-d206-45e3-b68a-6b625b8b1f28" Sep 09 20:11:40.940915 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:40.940222 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:40.940915 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:40.940608 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtgl" podUID="05f8baf8-a386-4aca-b3df-d9cf4e3cec64" Sep 09 20:11:40.940915 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:40.940683 2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89nn6" podUID="9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7" Sep 09 20:11:42.742040 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.742003 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:42.742480 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.742059 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:42.742480 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.742166 2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:42.742480 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.742181 2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:42.742480 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.742220 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret podName:05f8baf8-a386-4aca-b3df-d9cf4e3cec64 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:14.742206159 +0000 UTC m=+66.274524105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret") pod "global-pull-secret-syncer-6gtgl" (UID: "05f8baf8-a386-4aca-b3df-d9cf4e3cec64") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:42.742480 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.742236 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs podName:f1d884e3-d206-45e3-b68a-6b625b8b1f28 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:14.742229639 +0000 UTC m=+66.274547584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs") pod "network-metrics-daemon-62rbr" (UID: "f1d884e3-d206-45e3-b68a-6b625b8b1f28") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:42.810318 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.810257 2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-188.ec2.internal" event="NodeReady" Sep 09 20:11:42.810466 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.810381 2541 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 20:11:42.842617 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.842587 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:42.842780 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.842742 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:42.842780 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.842761 2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:42.842780 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.842773 2541 projected.go:196] Error preparing data for projected volume kube-api-access-r96lv for pod openshift-network-diagnostics/network-check-target-89nn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:42.842976 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:42.842847 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv podName:9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:14.842829886 +0000 UTC m=+66.375147841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r96lv" (UniqueName: "kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv") pod "network-check-target-89nn6" (UID: "9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:42.850323 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.850302 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k684v"] Sep 09 20:11:42.857289 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.857265 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8s8mr"] Sep 09 20:11:42.857420 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.857401 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k684v" Sep 09 20:11:42.859973 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.859946 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 20:11:42.859973 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.859970 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zh2q\"" Sep 09 20:11:42.860146 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.860128 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 20:11:42.861972 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.861602 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:42.861972 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.861835 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k684v"] Sep 09 20:11:42.864005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.863987 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 20:11:42.864202 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.864180 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xhs4j\"" Sep 09 20:11:42.864403 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.864386 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 20:11:42.864617 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.864591 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 20:11:42.869466 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.869444 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8s8mr"] Sep 09 20:11:42.939972 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.939949 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:11:42.940105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.939949 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:11:42.940161 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.939949 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:11:42.942712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.942692 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:11:42.942842 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.942718 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:11:42.942842 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.942819 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-52lgp\"" Sep 09 20:11:42.942942 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.942895 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9dttj\"" Sep 09 20:11:42.942942 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.942935 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:11:42.943085 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943070 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:11:42.943691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943192 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbnp2\" (UniqueName: \"kubernetes.io/projected/85648db9-f2d7-432a-aac7-7302ca7bc2d6-kube-api-access-fbnp2\") pod \"ingress-canary-8s8mr\" (UID: \"85648db9-f2d7-432a-aac7-7302ca7bc2d6\") " pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:42.943691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943226 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddgwn\" (UniqueName: \"kubernetes.io/projected/934b5026-ecec-4d53-92ae-0896a9634fc5-kube-api-access-ddgwn\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:42.943691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943270 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85648db9-f2d7-432a-aac7-7302ca7bc2d6-cert\") pod \"ingress-canary-8s8mr\" (UID: \"85648db9-f2d7-432a-aac7-7302ca7bc2d6\") " pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:42.943691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943364 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:42.943691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943409 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/934b5026-ecec-4d53-92ae-0896a9634fc5-tmp-dir\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:42.943691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:42.943471 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/934b5026-ecec-4d53-92ae-0896a9634fc5-config-volume\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.043922 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.043902 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbnp2\" (UniqueName: \"kubernetes.io/projected/85648db9-f2d7-432a-aac7-7302ca7bc2d6-kube-api-access-fbnp2\") pod \"ingress-canary-8s8mr\" (UID: \"85648db9-f2d7-432a-aac7-7302ca7bc2d6\") " pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:43.044061 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.043941 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddgwn\" (UniqueName: \"kubernetes.io/projected/934b5026-ecec-4d53-92ae-0896a9634fc5-kube-api-access-ddgwn\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.044061 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.043984 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85648db9-f2d7-432a-aac7-7302ca7bc2d6-cert\") pod \"ingress-canary-8s8mr\" (UID: \"85648db9-f2d7-432a-aac7-7302ca7bc2d6\") " pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:43.044061 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.044029 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.044214 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.044065 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/934b5026-ecec-4d53-92ae-0896a9634fc5-tmp-dir\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.044214 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.044126 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/934b5026-ecec-4d53-92ae-0896a9634fc5-config-volume\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.044214 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:43.044195 2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:11:43.044357 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:43.044255 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls podName:934b5026-ecec-4d53-92ae-0896a9634fc5 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:43.544234982 +0000 UTC m=+35.076552947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls") pod "dns-default-k684v" (UID: "934b5026-ecec-4d53-92ae-0896a9634fc5") : secret "dns-default-metrics-tls" not found Sep 09 20:11:43.044821 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.044631 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/934b5026-ecec-4d53-92ae-0896a9634fc5-tmp-dir\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.044821 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.044746 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/934b5026-ecec-4d53-92ae-0896a9634fc5-config-volume\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.049286 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.049246 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85648db9-f2d7-432a-aac7-7302ca7bc2d6-cert\") pod \"ingress-canary-8s8mr\" (UID: \"85648db9-f2d7-432a-aac7-7302ca7bc2d6\") " pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:43.056243 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.056223 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddgwn\" (UniqueName: \"kubernetes.io/projected/934b5026-ecec-4d53-92ae-0896a9634fc5-kube-api-access-ddgwn\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.056346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.056329 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbnp2\" (UniqueName: \"kubernetes.io/projected/85648db9-f2d7-432a-aac7-7302ca7bc2d6-kube-api-access-fbnp2\") pod \"ingress-canary-8s8mr\" (UID: \"85648db9-f2d7-432a-aac7-7302ca7bc2d6\") " pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:43.177473 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.177454 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8s8mr" Sep 09 20:11:43.473307 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.473280 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8s8mr"] Sep 09 20:11:43.480838 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:43.480807 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85648db9_f2d7_432a_aac7_7302ca7bc2d6.slice/crio-fe298ba1fb7bba44be729a6171f0288a0ea5df6d414d129d1d64ee62cdec402b WatchSource:0}: Error finding container fe298ba1fb7bba44be729a6171f0288a0ea5df6d414d129d1d64ee62cdec402b: Status 404 returned error can't find the container with id fe298ba1fb7bba44be729a6171f0288a0ea5df6d414d129d1d64ee62cdec402b Sep 09 20:11:43.549049 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:43.548885 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:43.549152 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:43.549062 2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:11:43.549152 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:43.549125 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls podName:934b5026-ecec-4d53-92ae-0896a9634fc5 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:44.549108671 +0000 UTC m=+36.081426613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls") pod "dns-default-k684v" (UID: "934b5026-ecec-4d53-92ae-0896a9634fc5") : secret "dns-default-metrics-tls" not found Sep 09 20:11:44.227500 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.227459 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8s8mr" event={"ID":"85648db9-f2d7-432a-aac7-7302ca7bc2d6","Type":"ContainerStarted","Data":"fe298ba1fb7bba44be729a6171f0288a0ea5df6d414d129d1d64ee62cdec402b"} Sep 09 20:11:44.230675 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.230646 2541 generic.go:356] "Generic (PLEG): container finished" podID="6912f6b4-9bd7-4511-8375-58364bea40ce" containerID="027faa1af091ca362c91a3a32057b0468308bbf0c73d328755aee0fb5d11aa37" exitCode=0 Sep 09 20:11:44.230804 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.230691 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerDied","Data":"027faa1af091ca362c91a3a32057b0468308bbf0c73d328755aee0fb5d11aa37"} Sep 09 20:11:44.556216 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.556135 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:44.556364 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:44.556277 2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:11:44.556364 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:44.556361 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls podName:934b5026-ecec-4d53-92ae-0896a9634fc5 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:46.556340096 +0000 UTC m=+38.088658060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls") pod "dns-default-k684v" (UID: "934b5026-ecec-4d53-92ae-0896a9634fc5") : secret "dns-default-metrics-tls" not found Sep 09 20:11:44.897541 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.897511 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-66t2s"] Sep 09 20:11:44.911918 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.911895 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-66t2s"] Sep 09 20:11:44.912052 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.911999 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:44.914385 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.914355 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 20:11:44.914385 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.914374 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 20:11:44.914581 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.914425 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 20:11:44.914581 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.914485 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 20:11:44.914890 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:44.914852 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7dnt6\"" Sep 09 20:11:45.060074 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.060029 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm45j\" (UniqueName: \"kubernetes.io/projected/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-api-access-qm45j\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.060265 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.060140 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-crio-socket\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.060265 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.060169 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.060265 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.060192 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.060265 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.060231 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-data-volume\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.161627 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.161544 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm45j\" (UniqueName: \"kubernetes.io/projected/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-api-access-qm45j\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.161627 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.161614 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-crio-socket\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.161880 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.161642 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.161880 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.161674 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.161880 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.161717 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-data-volume\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.162021 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.161921 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-crio-socket\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.162021 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.162010 2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:11:45.162126 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.162045 2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:11:45.162126 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.162065 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:45.662049657 +0000 UTC m=+37.194367599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : configmap "kube-rbac-proxy" not found Sep 09 20:11:45.162126 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.162101 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:45.662083142 +0000 UTC m=+37.194401104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : secret "insights-runtime-extractor-tls" not found Sep 09 20:11:45.162126 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.162103 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-data-volume\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.170994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.170971 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm45j\" (UniqueName: \"kubernetes.io/projected/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-api-access-qm45j\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.237077 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.237047 2541 generic.go:356] "Generic (PLEG): container finished" podID="6912f6b4-9bd7-4511-8375-58364bea40ce" containerID="6f38bc809d9186b48f03e9d411b5068ef351e5706dc0027b7b36c575e821407b" exitCode=0 Sep 09 20:11:45.237518 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.237115 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerDied","Data":"6f38bc809d9186b48f03e9d411b5068ef351e5706dc0027b7b36c575e821407b"} Sep 09 20:11:45.665479 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.665443 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.665479 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.665482 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:45.665668 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.665568 2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:11:45.665668 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.665592 2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:11:45.665668 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.665633 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:46.66561774 +0000 UTC m=+38.197935705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : configmap "kube-rbac-proxy" not found Sep 09 20:11:45.665668 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:45.665647 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:46.665640858 +0000 UTC m=+38.197958799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : secret "insights-runtime-extractor-tls" not found Sep 09 20:11:45.715443 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.715418 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj"] Sep 09 20:11:45.726223 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.726197 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj"] Sep 09 20:11:45.726355 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.726330 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" Sep 09 20:11:45.729083 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.729059 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 20:11:45.729312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.729286 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 20:11:45.730273 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.729920 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wptpk\"" Sep 09 20:11:45.867159 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.867127 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hvxs\" (UniqueName: \"kubernetes.io/projected/cee851fb-a424-4065-b47a-456cdb42af87-kube-api-access-9hvxs\") pod \"migrator-fdbb8fdff-mx5sj\" (UID: \"cee851fb-a424-4065-b47a-456cdb42af87\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" Sep 09 20:11:45.968301 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.968237 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hvxs\" (UniqueName: \"kubernetes.io/projected/cee851fb-a424-4065-b47a-456cdb42af87-kube-api-access-9hvxs\") pod \"migrator-fdbb8fdff-mx5sj\" (UID: \"cee851fb-a424-4065-b47a-456cdb42af87\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" Sep 09 20:11:45.979369 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:45.979350 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hvxs\" (UniqueName: \"kubernetes.io/projected/cee851fb-a424-4065-b47a-456cdb42af87-kube-api-access-9hvxs\") pod \"migrator-fdbb8fdff-mx5sj\" (UID: \"cee851fb-a424-4065-b47a-456cdb42af87\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" Sep 09 20:11:46.039129 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.039101 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" Sep 09 20:11:46.240979 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.240906 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8s8mr" event={"ID":"85648db9-f2d7-432a-aac7-7302ca7bc2d6","Type":"ContainerStarted","Data":"943bca1c03ac087ab168d2666f1c7732b1a35663136405fc151b2d27991d59ae"} Sep 09 20:11:46.244884 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.244859 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" event={"ID":"6912f6b4-9bd7-4511-8375-58364bea40ce","Type":"ContainerStarted","Data":"18fec6923f74356c62263e5c97e272b3db6205b35f3619f3fa4eb130e0c4be53"} Sep 09 20:11:46.256915 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.256677 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8s8mr" podStartSLOduration=1.7647383319999999 podStartE2EDuration="4.256658914s" totalImagesPullingTime="2.491920582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:46.255748008 +0000 UTC m=+37.788065971" watchObservedRunningTime="2026-09-09 20:11:46.256658914 +0000 UTC m=+37.788976898" Sep 09 20:11:46.275620 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.275570 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q9xlx" podStartSLOduration=9.010628309 podStartE2EDuration="37.275556122s" totalImagesPullingTime="28.264927813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:46.274549789 +0000 UTC m=+37.806867753" watchObservedRunningTime="2026-09-09 20:11:46.275556122 +0000 UTC m=+37.807874085" Sep 09 20:11:46.312502 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.312472 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj"] Sep 09 20:11:46.316509 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:46.316478 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee851fb_a424_4065_b47a_456cdb42af87.slice/crio-3cd85fa369f5fb632c399434aa3aa98ef128c2325d5bad82692dc734d636b8a1 WatchSource:0}: Error finding container 3cd85fa369f5fb632c399434aa3aa98ef128c2325d5bad82692dc734d636b8a1: Status 404 returned error can't find the container with id 3cd85fa369f5fb632c399434aa3aa98ef128c2325d5bad82692dc734d636b8a1 Sep 09 20:11:46.573724 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.573641 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:46.573898 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:46.573779 2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:11:46.573898 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:46.573853 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls podName:934b5026-ecec-4d53-92ae-0896a9634fc5 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:50.57383787 +0000 UTC m=+42.106155825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls") pod "dns-default-k684v" (UID: "934b5026-ecec-4d53-92ae-0896a9634fc5") : secret "dns-default-metrics-tls" not found Sep 09 20:11:46.674185 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.674138 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:46.674185 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.674184 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:46.674423 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:46.674262 2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:11:46.674423 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:46.674300 2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:11:46.674423 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:46.674328 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:48.674310913 +0000 UTC m=+40.206628872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : configmap "kube-rbac-proxy" not found Sep 09 20:11:46.674423 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:46.674345 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:48.674333865 +0000 UTC m=+40.206651817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : secret "insights-runtime-extractor-tls" not found Sep 09 20:11:46.675978 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:46.675958 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dnkr_d0a6fa4b-86f9-48a7-a9de-f3243f01da37/dns-node-resolver/0.log" Sep 09 20:11:47.248666 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.248579 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" event={"ID":"cee851fb-a424-4065-b47a-456cdb42af87","Type":"ContainerStarted","Data":"3cd85fa369f5fb632c399434aa3aa98ef128c2325d5bad82692dc734d636b8a1"} Sep 09 20:11:47.436616 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.436586 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-5cc89"] Sep 09 20:11:47.454147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.454119 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-5cc89"] Sep 09 20:11:47.454286 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.454234 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.456948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.456927 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 09 20:11:47.456948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.456946 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 09 20:11:47.456948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.456927 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-96llq\"" Sep 09 20:11:47.457163 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.456985 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 09 20:11:47.458064 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.458047 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 09 20:11:47.581993 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.581919 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-signing-cabundle\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.581993 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.581953 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685b6\" (UniqueName: \"kubernetes.io/projected/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-kube-api-access-685b6\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.582154 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.581995 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-signing-key\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.682957 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.682920 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-signing-cabundle\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.682957 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.682962 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685b6\" (UniqueName: \"kubernetes.io/projected/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-kube-api-access-685b6\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.683192 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.682996 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-signing-key\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.683583 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.683560 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-signing-cabundle\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.686638 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.686608 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-signing-key\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.693503 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.693469 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-685b6\" (UniqueName: \"kubernetes.io/projected/a764b6ac-9b0f-4184-9cc5-357fe44b4b41-kube-api-access-685b6\") pod \"service-ca-75d99c484-5cc89\" (UID: \"a764b6ac-9b0f-4184-9cc5-357fe44b4b41\") " pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.765686 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.765644 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-5cc89" Sep 09 20:11:47.875932 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:47.875908 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-md7hk_f1c4b62d-3bae-47de-9a3f-0563d369a76a/node-ca/0.log" Sep 09 20:11:48.126037 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:48.125969 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-5cc89"] Sep 09 20:11:48.207403 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:48.207374 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda764b6ac_9b0f_4184_9cc5_357fe44b4b41.slice/crio-133effa50d9caee4790a84faf76052a191c6ce97c8ec6d27bcf4da24bda9eee9 WatchSource:0}: Error finding container 133effa50d9caee4790a84faf76052a191c6ce97c8ec6d27bcf4da24bda9eee9: Status 404 returned error can't find the container with id 133effa50d9caee4790a84faf76052a191c6ce97c8ec6d27bcf4da24bda9eee9 Sep 09 20:11:48.252146 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:48.252117 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-5cc89" event={"ID":"a764b6ac-9b0f-4184-9cc5-357fe44b4b41","Type":"ContainerStarted","Data":"133effa50d9caee4790a84faf76052a191c6ce97c8ec6d27bcf4da24bda9eee9"} Sep 09 20:11:48.476337 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:48.476158 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8s8mr_85648db9-f2d7-432a-aac7-7302ca7bc2d6/serve-healthcheck-canary/0.log" Sep 09 20:11:48.691404 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:48.691334 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:48.691522 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:48.691451 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:48.691522 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:48.691487 2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:11:48.691522 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:48.691513 2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:11:48.691618 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:48.691552 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:52.691536076 +0000 UTC m=+44.223854033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : configmap "kube-rbac-proxy" not found Sep 09 20:11:48.691618 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:48.691567 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:11:52.691559187 +0000 UTC m=+44.223877129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : secret "insights-runtime-extractor-tls" not found Sep 09 20:11:49.257008 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:49.256971 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" event={"ID":"cee851fb-a424-4065-b47a-456cdb42af87","Type":"ContainerStarted","Data":"7660e55198300825fa7cb7cd725b35ed54cfbef30c39b05a74b10f5df4784e61"} Sep 09 20:11:49.257449 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:49.257059 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" event={"ID":"cee851fb-a424-4065-b47a-456cdb42af87","Type":"ContainerStarted","Data":"c5ce19e71be356a04d2f711d0bf0c38d80515cbeac46b67f9e5652ae17eb2af7"} Sep 09 20:11:49.276357 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:49.276307 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mx5sj" podStartSLOduration=2.3603739519999998 podStartE2EDuration="4.27629263s" totalImagesPullingTime="1.915918678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:49.275804198 +0000 UTC m=+40.808122164" watchObservedRunningTime="2026-09-09 20:11:49.27629263 +0000 UTC m=+40.808610594" Sep 09 20:11:50.605341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:50.605304 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:50.605712 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:50.605469 2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:11:50.605712 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:50.605546 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls podName:934b5026-ecec-4d53-92ae-0896a9634fc5 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:58.605530994 +0000 UTC m=+50.137848972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls") pod "dns-default-k684v" (UID: "934b5026-ecec-4d53-92ae-0896a9634fc5") : secret "dns-default-metrics-tls" not found Sep 09 20:11:51.263274 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:51.263239 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-5cc89" event={"ID":"a764b6ac-9b0f-4184-9cc5-357fe44b4b41","Type":"ContainerStarted","Data":"dcce3df2dc88a3e83ba9b4d62ddea0b16248c584e598647189a2c5b026cc77d6"} Sep 09 20:11:51.279317 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:51.279268 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-5cc89" podStartSLOduration=1.842956489 podStartE2EDuration="4.279253979s" totalImagesPullingTime="2.43629749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.279076545 +0000 UTC m=+42.811394522" watchObservedRunningTime="2026-09-09 20:11:51.279253979 +0000 UTC m=+42.811571958" Sep 09 20:11:52.725213 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:52.725172 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:52.725699 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:52.725304 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:52.725699 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:52.725324 2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:11:52.725699 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:11:52.725415 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls podName:1c2f941c-7dcc-459d-ba5a-6243cd0715ab nodeName:}" failed. No retries permitted until 2026-09-09 20:12:00.725394891 +0000 UTC m=+52.257712848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-66t2s" (UID: "1c2f941c-7dcc-459d-ba5a-6243cd0715ab") : secret "insights-runtime-extractor-tls" not found Sep 09 20:11:52.725888 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:52.725867 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:11:58.666065 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:58.666032 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:58.669125 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:58.669085 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934b5026-ecec-4d53-92ae-0896a9634fc5-metrics-tls\") pod \"dns-default-k684v\" (UID: \"934b5026-ecec-4d53-92ae-0896a9634fc5\") " pod="openshift-dns/dns-default-k684v" Sep 09 20:11:58.770302 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:58.770272 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k684v" Sep 09 20:11:59.055752 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:59.055684 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k684v"] Sep 09 20:11:59.058858 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:11:59.058830 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934b5026_ecec_4d53_92ae_0896a9634fc5.slice/crio-cbd9853a54d923c4afc362779427a43ebcf52801e6bd281e820b5a539ce4fc74 WatchSource:0}: Error finding container cbd9853a54d923c4afc362779427a43ebcf52801e6bd281e820b5a539ce4fc74: Status 404 returned error can't find the container with id cbd9853a54d923c4afc362779427a43ebcf52801e6bd281e820b5a539ce4fc74 Sep 09 20:11:59.286474 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:11:59.286441 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k684v" event={"ID":"934b5026-ecec-4d53-92ae-0896a9634fc5","Type":"ContainerStarted","Data":"cbd9853a54d923c4afc362779427a43ebcf52801e6bd281e820b5a539ce4fc74"} Sep 09 20:12:00.781527 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:00.781479 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:12:00.784288 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:00.784259 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c2f941c-7dcc-459d-ba5a-6243cd0715ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66t2s\" (UID: \"1c2f941c-7dcc-459d-ba5a-6243cd0715ab\") " pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:12:00.820741 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:00.820716 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-66t2s" Sep 09 20:12:01.248187 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:01.248119 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-66t2s"] Sep 09 20:12:01.250412 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:01.250390 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2f941c_7dcc_459d_ba5a_6243cd0715ab.slice/crio-8c48f0ea8faf403c024cf623cd3a9a00c98e494f5baad7edc8bd7b8f7d96ec91 WatchSource:0}: Error finding container 8c48f0ea8faf403c024cf623cd3a9a00c98e494f5baad7edc8bd7b8f7d96ec91: Status 404 returned error can't find the container with id 8c48f0ea8faf403c024cf623cd3a9a00c98e494f5baad7edc8bd7b8f7d96ec91 Sep 09 20:12:01.293659 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:01.293632 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k684v" event={"ID":"934b5026-ecec-4d53-92ae-0896a9634fc5","Type":"ContainerStarted","Data":"ea5d6f23c4648992bb991d5e31c95b1fe7c932880fcaa574f009e270c3e6af7f"} Sep 09 20:12:01.293743 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:01.293691 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k684v" event={"ID":"934b5026-ecec-4d53-92ae-0896a9634fc5","Type":"ContainerStarted","Data":"9a57876c17918d08cf2a85c0b36884e43aeade56203fa55a80689acb20abe088"} Sep 09 20:12:01.293743 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:01.293723 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k684v" Sep 09 20:12:01.295313 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:01.295291 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66t2s" event={"ID":"1c2f941c-7dcc-459d-ba5a-6243cd0715ab","Type":"ContainerStarted","Data":"8c48f0ea8faf403c024cf623cd3a9a00c98e494f5baad7edc8bd7b8f7d96ec91"} Sep 09 20:12:01.310869 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:01.310833 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k684v" podStartSLOduration=17.360467141 podStartE2EDuration="19.310818058s" totalImagesPullingTime="1.950350917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:01.310198552 +0000 UTC m=+52.842516515" watchObservedRunningTime="2026-09-09 20:12:01.310818058 +0000 UTC m=+52.843136053" Sep 09 20:12:02.300472 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:02.300432 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66t2s" event={"ID":"1c2f941c-7dcc-459d-ba5a-6243cd0715ab","Type":"ContainerStarted","Data":"f7f9d827703abdfb20eedff6da8d9865c8ae031a30f5430e16c165920cda7862"} Sep 09 20:12:02.300865 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:02.300501 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66t2s" event={"ID":"1c2f941c-7dcc-459d-ba5a-6243cd0715ab","Type":"ContainerStarted","Data":"6756719c8ef3d4b5b69a50af10a8242fa7f393dc5490d066f7db8d96cb09ef45"} Sep 09 20:12:04.309057 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:04.308970 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66t2s" event={"ID":"1c2f941c-7dcc-459d-ba5a-6243cd0715ab","Type":"ContainerStarted","Data":"3d977e36f4f209101eebdc5fc035b88c7e1f06871c32853f8bdc61114d95d8eb"} Sep 09 20:12:04.328653 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:04.328607 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-66t2s" podStartSLOduration=17.73241656 podStartE2EDuration="20.32859343s" totalImagesPullingTime="2.59617687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:04.327935513 +0000 UTC m=+55.860253477" watchObservedRunningTime="2026-09-09 20:12:04.32859343 +0000 UTC m=+55.860911388" Sep 09 20:12:08.219584 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.219555 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2c279" Sep 09 20:12:08.826755 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.826725 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6"] Sep 09 20:12:08.829185 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.829171 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:08.832124 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.832103 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vtwv9\"" Sep 09 20:12:08.833003 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.832985 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 20:12:08.833003 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.832998 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 20:12:08.833258 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.833245 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 20:12:08.833326 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.833307 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 09 20:12:08.841993 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.841970 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6"] Sep 09 20:12:08.921870 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.921843 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c57969f4c-bc8c5"] Sep 09 20:12:08.923515 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.923501 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:08.925880 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.925865 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 20:12:08.926066 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.926050 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 20:12:08.926282 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.926270 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4lhjh\"" Sep 09 20:12:08.926330 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.926319 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 20:12:08.930757 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.930734 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 20:12:08.940373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.940351 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmqzx\" (UniqueName: \"kubernetes.io/projected/6c2d6754-f4ba-4f2d-9568-2aeb474876af-kube-api-access-cmqzx\") pod \"managed-serviceaccount-addon-agent-64d75445b8-7gvj6\" (UID: \"6c2d6754-f4ba-4f2d-9568-2aeb474876af\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:08.940457 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.940431 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c2d6754-f4ba-4f2d-9568-2aeb474876af-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64d75445b8-7gvj6\" (UID: \"6c2d6754-f4ba-4f2d-9568-2aeb474876af\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:08.943637 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:08.943617 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c57969f4c-bc8c5"] Sep 09 20:12:09.040685 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040651 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2391b738-d832-459c-a26b-8aea368c6a81-ca-trust-extracted\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040685 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040678 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2391b738-d832-459c-a26b-8aea368c6a81-installation-pull-secrets\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040708 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2391b738-d832-459c-a26b-8aea368c6a81-trusted-ca\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040726 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-bound-sa-token\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040784 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c2d6754-f4ba-4f2d-9568-2aeb474876af-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64d75445b8-7gvj6\" (UID: \"6c2d6754-f4ba-4f2d-9568-2aeb474876af\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040830 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-registry-tls\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040848 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tfc\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-kube-api-access-d8tfc\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040884 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2391b738-d832-459c-a26b-8aea368c6a81-registry-certificates\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040907 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmqzx\" (UniqueName: \"kubernetes.io/projected/6c2d6754-f4ba-4f2d-9568-2aeb474876af-kube-api-access-cmqzx\") pod \"managed-serviceaccount-addon-agent-64d75445b8-7gvj6\" (UID: \"6c2d6754-f4ba-4f2d-9568-2aeb474876af\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:09.040948 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.040938 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2391b738-d832-459c-a26b-8aea368c6a81-image-registry-private-configuration\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.043350 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.043331 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 09 20:12:09.050766 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.050748 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 20:12:09.053404 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.053382 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c2d6754-f4ba-4f2d-9568-2aeb474876af-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64d75445b8-7gvj6\" (UID: \"6c2d6754-f4ba-4f2d-9568-2aeb474876af\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:09.061703 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.061686 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 20:12:09.074714 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.074689 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmqzx\" (UniqueName: \"kubernetes.io/projected/6c2d6754-f4ba-4f2d-9568-2aeb474876af-kube-api-access-cmqzx\") pod \"managed-serviceaccount-addon-agent-64d75445b8-7gvj6\" (UID: \"6c2d6754-f4ba-4f2d-9568-2aeb474876af\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:09.141388 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141363 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2391b738-d832-459c-a26b-8aea368c6a81-registry-certificates\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141544 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141437 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2391b738-d832-459c-a26b-8aea368c6a81-image-registry-private-configuration\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141544 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141477 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2391b738-d832-459c-a26b-8aea368c6a81-ca-trust-extracted\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141544 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141504 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2391b738-d832-459c-a26b-8aea368c6a81-installation-pull-secrets\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141716 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141553 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2391b738-d832-459c-a26b-8aea368c6a81-trusted-ca\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141716 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141624 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-bound-sa-token\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141716 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141680 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-registry-tls\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141716 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141705 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tfc\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-kube-api-access-d8tfc\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.141941 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.141860 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2391b738-d832-459c-a26b-8aea368c6a81-ca-trust-extracted\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.142258 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.142234 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2391b738-d832-459c-a26b-8aea368c6a81-registry-certificates\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.142594 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.142453 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2391b738-d832-459c-a26b-8aea368c6a81-trusted-ca\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.144099 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.144045 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2391b738-d832-459c-a26b-8aea368c6a81-image-registry-private-configuration\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.144099 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.144091 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-registry-tls\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.144207 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.144160 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2391b738-d832-459c-a26b-8aea368c6a81-installation-pull-secrets\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.149088 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.149064 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 20:12:09.150483 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.150465 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-bound-sa-token\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.150636 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.150614 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tfc\" (UniqueName: \"kubernetes.io/projected/2391b738-d832-459c-a26b-8aea368c6a81-kube-api-access-d8tfc\") pod \"image-registry-c57969f4c-bc8c5\" (UID: \"2391b738-d832-459c-a26b-8aea368c6a81\") " pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.159280 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.159262 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vtwv9\"" Sep 09 20:12:09.168281 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.168255 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" Sep 09 20:12:09.232309 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.232282 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:09.432857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.432834 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6"] Sep 09 20:12:09.435216 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:09.435194 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c2d6754_f4ba_4f2d_9568_2aeb474876af.slice/crio-4c31699ab6f3079b73c87f364cb2af83d07684afffd259442e3fa4af10265996 WatchSource:0}: Error finding container 4c31699ab6f3079b73c87f364cb2af83d07684afffd259442e3fa4af10265996: Status 404 returned error can't find the container with id 4c31699ab6f3079b73c87f364cb2af83d07684afffd259442e3fa4af10265996 Sep 09 20:12:09.534928 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:09.534900 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c57969f4c-bc8c5"] Sep 09 20:12:09.537732 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:09.537709 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2391b738_d832_459c_a26b_8aea368c6a81.slice/crio-b931a5ad90dfd127294b316482115a59ac8471a3cdd1af278458ca44d78d3085 WatchSource:0}: Error finding container b931a5ad90dfd127294b316482115a59ac8471a3cdd1af278458ca44d78d3085: Status 404 returned error can't find the container with id b931a5ad90dfd127294b316482115a59ac8471a3cdd1af278458ca44d78d3085 Sep 09 20:12:10.331223 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:10.331177 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" event={"ID":"2391b738-d832-459c-a26b-8aea368c6a81","Type":"ContainerStarted","Data":"049389c3bb58c9a3d301a35b657413408d81acc0a95674b02499e55f343fe5ca"} Sep 09 20:12:10.331662 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:10.331238 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" event={"ID":"2391b738-d832-459c-a26b-8aea368c6a81","Type":"ContainerStarted","Data":"b931a5ad90dfd127294b316482115a59ac8471a3cdd1af278458ca44d78d3085"} Sep 09 20:12:10.331662 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:10.331300 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:10.332718 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:10.332697 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" event={"ID":"6c2d6754-f4ba-4f2d-9568-2aeb474876af","Type":"ContainerStarted","Data":"4c31699ab6f3079b73c87f364cb2af83d07684afffd259442e3fa4af10265996"} Sep 09 20:12:10.351488 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:10.350974 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" podStartSLOduration=2.350955971 podStartE2EDuration="2.350955971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:10.349872409 +0000 UTC m=+61.882190374" watchObservedRunningTime="2026-09-09 20:12:10.350955971 +0000 UTC m=+61.883273938" Sep 09 20:12:11.303014 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:11.302986 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k684v" Sep 09 20:12:12.342069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:12.342031 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" event={"ID":"6c2d6754-f4ba-4f2d-9568-2aeb474876af","Type":"ContainerStarted","Data":"7b405d3a6886af596209ba767a742d9e1bad0dfeafba81a8d70c16fb44ee60eb"} Sep 09 20:12:12.358143 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:12.358094 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64d75445b8-7gvj6" podStartSLOduration=1.993009526 podStartE2EDuration="4.358074129s" totalImagesPullingTime="2.365064603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:12.357649779 +0000 UTC m=+63.889967743" watchObservedRunningTime="2026-09-09 20:12:12.358074129 +0000 UTC m=+63.890392094" Sep 09 20:12:13.913324 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:13.913291 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr"] Sep 09 20:12:13.935116 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:13.935089 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr"] Sep 09 20:12:13.935238 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:13.935178 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:13.937692 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:13.937670 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 20:12:13.937823 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:13.937717 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tp9d9\"" Sep 09 20:12:13.974576 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:13.974550 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cca8c7ae-e41b-482e-b95b-8e0345f66e1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cl5cr\" (UID: \"cca8c7ae-e41b-482e-b95b-8e0345f66e1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:14.075669 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.075632 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cca8c7ae-e41b-482e-b95b-8e0345f66e1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cl5cr\" (UID: \"cca8c7ae-e41b-482e-b95b-8e0345f66e1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:14.075838 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:14.075819 2541 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 09 20:12:14.075911 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:14.075899 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca8c7ae-e41b-482e-b95b-8e0345f66e1d-tls-certificates podName:cca8c7ae-e41b-482e-b95b-8e0345f66e1d nodeName:}" failed. No retries permitted until 2026-09-09 20:12:14.57587793 +0000 UTC m=+66.108195880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cca8c7ae-e41b-482e-b95b-8e0345f66e1d-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-cl5cr" (UID: "cca8c7ae-e41b-482e-b95b-8e0345f66e1d") : secret "prometheus-operator-admission-webhook-tls" not found Sep 09 20:12:14.579681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.579642 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cca8c7ae-e41b-482e-b95b-8e0345f66e1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cl5cr\" (UID: \"cca8c7ae-e41b-482e-b95b-8e0345f66e1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:14.582157 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.582135 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cca8c7ae-e41b-482e-b95b-8e0345f66e1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cl5cr\" (UID: \"cca8c7ae-e41b-482e-b95b-8e0345f66e1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:14.781582 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.781548 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:12:14.781737 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.781611 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:12:14.783982 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.783967 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:12:14.784938 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.784924 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:12:14.794232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.794211 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1d884e3-d206-45e3-b68a-6b625b8b1f28-metrics-certs\") pod \"network-metrics-daemon-62rbr\" (UID: \"f1d884e3-d206-45e3-b68a-6b625b8b1f28\") " pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:12:14.794346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.794246 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05f8baf8-a386-4aca-b3df-d9cf4e3cec64-original-pull-secret\") pod \"global-pull-secret-syncer-6gtgl\" (UID: \"05f8baf8-a386-4aca-b3df-d9cf4e3cec64\") " pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:12:14.843562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.843492 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:14.882042 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.882008 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:12:14.884460 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.884446 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:12:14.901749 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.901723 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:12:14.906507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:14.906429 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96lv\" (UniqueName: \"kubernetes.io/projected/9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7-kube-api-access-r96lv\") pod \"network-check-target-89nn6\" (UID: \"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7\") " pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:12:15.053991 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.053966 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9dttj\"" Sep 09 20:12:15.059035 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.059019 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtgl" Sep 09 20:12:15.062131 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.062108 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-62rbr" Sep 09 20:12:15.066063 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.066048 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-52lgp\"" Sep 09 20:12:15.074101 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.074083 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:12:15.109884 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.109777 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr"] Sep 09 20:12:15.113703 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:15.113667 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca8c7ae_e41b_482e_b95b_8e0345f66e1d.slice/crio-97d9b10be173c59fb7452ac9ed196882aaadce5c2b52581609aecefebfb9f0dc WatchSource:0}: Error finding container 97d9b10be173c59fb7452ac9ed196882aaadce5c2b52581609aecefebfb9f0dc: Status 404 returned error can't find the container with id 97d9b10be173c59fb7452ac9ed196882aaadce5c2b52581609aecefebfb9f0dc Sep 09 20:12:15.341159 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.341130 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gtgl"] Sep 09 20:12:15.344096 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.344072 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-62rbr"] Sep 09 20:12:15.344261 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:15.344223 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f8baf8_a386_4aca_b3df_d9cf4e3cec64.slice/crio-1b8ec943e35fdae58e18132d68c2da7e4fdcfa152d4590833e890dd4efe594b9 WatchSource:0}: Error finding container 1b8ec943e35fdae58e18132d68c2da7e4fdcfa152d4590833e890dd4efe594b9: Status 404 returned error can't find the container with id 1b8ec943e35fdae58e18132d68c2da7e4fdcfa152d4590833e890dd4efe594b9 Sep 09 20:12:15.347530 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:15.347514 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d884e3_d206_45e3_b68a_6b625b8b1f28.slice/crio-a3de9763faced7ec2cf6b45e0e09e9c1d95e45a80ce57af557b0c44dac0ff785 WatchSource:0}: Error finding container a3de9763faced7ec2cf6b45e0e09e9c1d95e45a80ce57af557b0c44dac0ff785: Status 404 returned error can't find the container with id a3de9763faced7ec2cf6b45e0e09e9c1d95e45a80ce57af557b0c44dac0ff785 Sep 09 20:12:15.355086 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.355063 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-62rbr" event={"ID":"f1d884e3-d206-45e3-b68a-6b625b8b1f28","Type":"ContainerStarted","Data":"a3de9763faced7ec2cf6b45e0e09e9c1d95e45a80ce57af557b0c44dac0ff785"} Sep 09 20:12:15.356136 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.356110 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gtgl" event={"ID":"05f8baf8-a386-4aca-b3df-d9cf4e3cec64","Type":"ContainerStarted","Data":"1b8ec943e35fdae58e18132d68c2da7e4fdcfa152d4590833e890dd4efe594b9"} Sep 09 20:12:15.357280 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.357251 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" event={"ID":"cca8c7ae-e41b-482e-b95b-8e0345f66e1d","Type":"ContainerStarted","Data":"97d9b10be173c59fb7452ac9ed196882aaadce5c2b52581609aecefebfb9f0dc"} Sep 09 20:12:15.361418 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:15.361314 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-89nn6"] Sep 09 20:12:15.363515 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:15.363496 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a16a0f3_9d54_4b2e_b4b0_c4f5a4084da7.slice/crio-9f9946564144e8cdfe7a632cfda47e51db60f1a59a4a5ebce3dac87ecc03bb72 WatchSource:0}: Error finding container 9f9946564144e8cdfe7a632cfda47e51db60f1a59a4a5ebce3dac87ecc03bb72: Status 404 returned error can't find the container with id 9f9946564144e8cdfe7a632cfda47e51db60f1a59a4a5ebce3dac87ecc03bb72 Sep 09 20:12:16.364325 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:16.364247 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-89nn6" event={"ID":"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7","Type":"ContainerStarted","Data":"9f9946564144e8cdfe7a632cfda47e51db60f1a59a4a5ebce3dac87ecc03bb72"} Sep 09 20:12:17.370884 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.370835 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-62rbr" event={"ID":"f1d884e3-d206-45e3-b68a-6b625b8b1f28","Type":"ContainerStarted","Data":"24d2cef9d7ecd4be899be612567a1d03620578e0a9147936e7bc0e373aa932b6"} Sep 09 20:12:17.371298 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.370948 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-62rbr" event={"ID":"f1d884e3-d206-45e3-b68a-6b625b8b1f28","Type":"ContainerStarted","Data":"c1d725fc668f083436f88750c52b517796b007cc30c9525aa25e7b53fc0de231"} Sep 09 20:12:17.373193 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.373163 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" event={"ID":"cca8c7ae-e41b-482e-b95b-8e0345f66e1d","Type":"ContainerStarted","Data":"404fc84b4fa3f7592883c8a736cf1ad892ba98d56a2441497b76a042561311e9"} Sep 09 20:12:17.376189 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.375344 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:17.381146 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.381130 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" Sep 09 20:12:17.389569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.389512 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-62rbr" podStartSLOduration=66.781458631 podStartE2EDuration="1m8.389500132s" totalImagesPullingTime="1.608041501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:17.388540219 +0000 UTC m=+68.920858186" watchObservedRunningTime="2026-09-09 20:12:17.389500132 +0000 UTC m=+68.921818097" Sep 09 20:12:17.406779 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:17.406726 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cl5cr" podStartSLOduration=2.569175214 podStartE2EDuration="4.406714521s" totalImagesPullingTime="1.837539307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:17.405396054 +0000 UTC m=+68.937714022" watchObservedRunningTime="2026-09-09 20:12:17.406714521 +0000 UTC m=+68.939032484" Sep 09 20:12:18.716490 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.716453 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-6nlwc"] Sep 09 20:12:18.719605 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.719582 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:18.722231 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.722202 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 20:12:18.722231 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.722217 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 20:12:18.722481 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.722465 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qspnk\"" Sep 09 20:12:18.730882 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.730850 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-6nlwc"] Sep 09 20:12:18.815403 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.815374 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjrd\" (UniqueName: \"kubernetes.io/projected/03baae22-0917-4aa4-b16b-245211440de0-kube-api-access-njjrd\") pod \"downloads-85d98c998f-6nlwc\" (UID: \"03baae22-0917-4aa4-b16b-245211440de0\") " pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:18.916771 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.916738 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjrd\" (UniqueName: \"kubernetes.io/projected/03baae22-0917-4aa4-b16b-245211440de0-kube-api-access-njjrd\") pod \"downloads-85d98c998f-6nlwc\" (UID: \"03baae22-0917-4aa4-b16b-245211440de0\") " pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:18.926147 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:18.926118 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjrd\" (UniqueName: \"kubernetes.io/projected/03baae22-0917-4aa4-b16b-245211440de0-kube-api-access-njjrd\") pod \"downloads-85d98c998f-6nlwc\" (UID: \"03baae22-0917-4aa4-b16b-245211440de0\") " pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:19.031659 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:19.031577 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:20.783564 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:20.783088 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-6nlwc"] Sep 09 20:12:20.787528 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:20.787496 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03baae22_0917_4aa4_b16b_245211440de0.slice/crio-e710309c2ee597a377239e0eb6e424e3b59d76a5932c577a551b250a0ff14571 WatchSource:0}: Error finding container e710309c2ee597a377239e0eb6e424e3b59d76a5932c577a551b250a0ff14571: Status 404 returned error can't find the container with id e710309c2ee597a377239e0eb6e424e3b59d76a5932c577a551b250a0ff14571 Sep 09 20:12:21.390249 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:21.390208 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gtgl" event={"ID":"05f8baf8-a386-4aca-b3df-d9cf4e3cec64","Type":"ContainerStarted","Data":"c12025e2ce7fc7488e8e64225fe90612768221ca8f0cd18d12cc82c920417a68"} Sep 09 20:12:21.391489 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:21.391464 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-6nlwc" event={"ID":"03baae22-0917-4aa4-b16b-245211440de0","Type":"ContainerStarted","Data":"e710309c2ee597a377239e0eb6e424e3b59d76a5932c577a551b250a0ff14571"} Sep 09 20:12:21.393152 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:21.393125 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-89nn6" event={"ID":"9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7","Type":"ContainerStarted","Data":"43d8962f5ad8293c7ec050004c1606e5e7c7458737fab17f096ff61cf5a25907"} Sep 09 20:12:21.393256 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:21.393180 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:12:21.408438 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:21.408378 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gtgl" podStartSLOduration=67.229426596 podStartE2EDuration="1m12.408360269s" totalImagesPullingTime="5.178933673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:21.407236465 +0000 UTC m=+72.939554431" watchObservedRunningTime="2026-09-09 20:12:21.408360269 +0000 UTC m=+72.940678236" Sep 09 20:12:21.422090 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:21.422043 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-89nn6" podStartSLOduration=67.272989414 podStartE2EDuration="1m12.422028021s" totalImagesPullingTime="5.149038607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:21.42107695 +0000 UTC m=+72.953394917" watchObservedRunningTime="2026-09-09 20:12:21.422028021 +0000 UTC m=+72.954345984" Sep 09 20:12:23.378761 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.377401 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bsttl"] Sep 09 20:12:23.380413 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.379950 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.383019 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.382830 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 20:12:23.383019 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.382847 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 20:12:23.383531 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.383230 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 20:12:23.383531 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.383408 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 20:12:23.384820 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.384015 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 20:12:23.384820 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.384218 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 20:12:23.384820 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.384377 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zl8h2\"" Sep 09 20:12:23.452547 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452513 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-wtmp\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.452697 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452568 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-root\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.452697 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452611 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-sys\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.452697 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452636 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.453051 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452670 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.453051 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452727 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrzbm\" (UniqueName: \"kubernetes.io/projected/b9639017-906c-415c-afc6-992d4eecd3d5-kube-api-access-jrzbm\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.453051 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452766 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-tls\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.453051 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452814 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9639017-906c-415c-afc6-992d4eecd3d5-metrics-client-ca\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.453051 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.452843 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-textfile\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553194 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-root\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553252 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-sys\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553276 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553308 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553336 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrzbm\" (UniqueName: \"kubernetes.io/projected/b9639017-906c-415c-afc6-992d4eecd3d5-kube-api-access-jrzbm\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553374 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-tls\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553403 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9639017-906c-415c-afc6-992d4eecd3d5-metrics-client-ca\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553429 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-textfile\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553459 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-wtmp\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553614 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-wtmp\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553664 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-root\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.553697 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9639017-906c-415c-afc6-992d4eecd3d5-sys\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.554728 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:23.554852 2541 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:23.554913 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-tls podName:b9639017-906c-415c-afc6-992d4eecd3d5 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:24.054892343 +0000 UTC m=+75.587210286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-tls") pod "node-exporter-bsttl" (UID: "b9639017-906c-415c-afc6-992d4eecd3d5") : secret "node-exporter-tls" not found Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.554910 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9639017-906c-415c-afc6-992d4eecd3d5-metrics-client-ca\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.555165 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.555116 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-textfile\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.564481 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.564437 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:23.566836 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:23.566768 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrzbm\" (UniqueName: \"kubernetes.io/projected/b9639017-906c-415c-afc6-992d4eecd3d5-kube-api-access-jrzbm\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:24.057733 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.057698 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-tls\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:24.060404 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.060374 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9639017-906c-415c-afc6-992d4eecd3d5-node-exporter-tls\") pod \"node-exporter-bsttl\" (UID: \"b9639017-906c-415c-afc6-992d4eecd3d5\") " pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:24.294250 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.294220 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsttl" Sep 09 20:12:24.307592 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:24.307562 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9639017_906c_415c_afc6_992d4eecd3d5.slice/crio-41941d86ba984b162cb428ca47895d2c074184d758a20c3a9c60a0c9a36bb736 WatchSource:0}: Error finding container 41941d86ba984b162cb428ca47895d2c074184d758a20c3a9c60a0c9a36bb736: Status 404 returned error can't find the container with id 41941d86ba984b162cb428ca47895d2c074184d758a20c3a9c60a0c9a36bb736 Sep 09 20:12:24.389313 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.389282 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:12:24.392368 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.392350 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.395034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.394837 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 20:12:24.395034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.394876 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 20:12:24.395034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.394837 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 20:12:24.395034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.394902 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 20:12:24.395034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.394881 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 20:12:24.395034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.394839 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 20:12:24.395732 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.395586 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 20:12:24.395732 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.395698 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 20:12:24.396867 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.396661 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-875zc\"" Sep 09 20:12:24.396867 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.396735 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 20:12:24.409658 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.409627 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsttl" event={"ID":"b9639017-906c-415c-afc6-992d4eecd3d5","Type":"ContainerStarted","Data":"41941d86ba984b162cb428ca47895d2c074184d758a20c3a9c60a0c9a36bb736"} Sep 09 20:12:24.409729 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.409686 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:12:24.461193 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461164 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461204 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461237 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461269 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461296 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461525 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461335 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461525 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461367 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-web-config\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461525 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461407 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461525 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461434 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461525 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461465 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tfb\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-kube-api-access-94tfb\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461525 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461510 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461841 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461542 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.461841 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.461577 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-out\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.562901 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.562757 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.562901 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.562869 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.562911 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-out\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.562944 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.562969 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.563002 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.563029 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.563056 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.563099 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.563127 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-web-config\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563681 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:24.563166 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle podName:4eacbd0a-160a-4afa-ae51-c74de745d5a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:25.063143417 +0000 UTC m=+76.595461359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2") : configmap references non-existent config key: ca-bundle.crt Sep 09 20:12:24.563681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.563244 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.563681 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:24.563445 2541 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 09 20:12:24.563681 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:12:24.563517 2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls podName:4eacbd0a-160a-4afa-ae51-c74de745d5a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:25.063496376 +0000 UTC m=+76.595814336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2") : secret "alertmanager-main-tls" not found Sep 09 20:12:24.564428 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.564404 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.565942 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.564677 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.565942 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.564726 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.565942 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.564752 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94tfb\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-kube-api-access-94tfb\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.567452 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.567370 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.568663 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.568440 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.569227 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.568904 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.569227 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.569138 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.569227 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.569172 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-out\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.569227 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.569183 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.570331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.570308 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.570885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.570850 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-web-config\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:24.578871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:24.578828 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tfb\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-kube-api-access-94tfb\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:25.068963 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.068916 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:25.069151 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.068990 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:25.070206 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.070176 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:25.072184 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.072134 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:25.298156 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.298112 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt"] Sep 09 20:12:25.301586 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.301561 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.303283 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.303262 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:12:25.304163 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.304141 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 20:12:25.304316 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.304167 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 20:12:25.304316 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.304180 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 20:12:25.304316 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.304227 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cgmtbm9udgb0m\"" Sep 09 20:12:25.304527 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.304458 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 20:12:25.305571 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.305130 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6vbgz\"" Sep 09 20:12:25.305571 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.305137 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 20:12:25.315134 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.315055 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt"] Sep 09 20:12:25.371205 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371179 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371343 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371228 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-tls\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371343 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371262 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371343 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371328 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45807f1c-3bdf-4e57-9caf-4b94080b3729-metrics-client-ca\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371627 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371416 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371627 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371445 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-grpc-tls\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371627 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371476 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.371627 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.371592 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ct8\" (UniqueName: \"kubernetes.io/projected/45807f1c-3bdf-4e57-9caf-4b94080b3729-kube-api-access-22ct8\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472532 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472504 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ct8\" (UniqueName: \"kubernetes.io/projected/45807f1c-3bdf-4e57-9caf-4b94080b3729-kube-api-access-22ct8\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472537 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472564 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-tls\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472579 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472624 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45807f1c-3bdf-4e57-9caf-4b94080b3729-metrics-client-ca\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472698 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472727 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-grpc-tls\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.472911 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.472753 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.473617 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.473592 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45807f1c-3bdf-4e57-9caf-4b94080b3729-metrics-client-ca\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.475544 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.475518 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.476079 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.475784 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-grpc-tls\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.476241 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.476222 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.476676 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.476649 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.476766 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.476734 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-tls\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.477390 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.477363 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/45807f1c-3bdf-4e57-9caf-4b94080b3729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.482579 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.482554 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ct8\" (UniqueName: \"kubernetes.io/projected/45807f1c-3bdf-4e57-9caf-4b94080b3729-kube-api-access-22ct8\") pod \"thanos-querier-7dfbbdb46f-f6kdt\" (UID: \"45807f1c-3bdf-4e57-9caf-4b94080b3729\") " pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.614103 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.614025 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:25.641278 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.641255 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:12:25.643583 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:25.643542 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eacbd0a_160a_4afa_ae51_c74de745d5a2.slice/crio-caba5047353656bdac3b9b5c41054f4440dde58148f23745b836710fce123046 WatchSource:0}: Error finding container caba5047353656bdac3b9b5c41054f4440dde58148f23745b836710fce123046: Status 404 returned error can't find the container with id caba5047353656bdac3b9b5c41054f4440dde58148f23745b836710fce123046 Sep 09 20:12:25.894816 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:25.894716 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt"] Sep 09 20:12:25.898755 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:25.898725 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45807f1c_3bdf_4e57_9caf_4b94080b3729.slice/crio-535954dac24b8e806fe09df0e24635307bf2ddbc304175a166c2f155f83be5b3 WatchSource:0}: Error finding container 535954dac24b8e806fe09df0e24635307bf2ddbc304175a166c2f155f83be5b3: Status 404 returned error can't find the container with id 535954dac24b8e806fe09df0e24635307bf2ddbc304175a166c2f155f83be5b3 Sep 09 20:12:26.421416 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:26.421312 2541 generic.go:356] "Generic (PLEG): container finished" podID="b9639017-906c-415c-afc6-992d4eecd3d5" containerID="5f3940cbe0cf980cd15f298bc6b60ce0ed523dd0006b6135a468d3c9a6f055fb" exitCode=0 Sep 09 20:12:26.421416 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:26.421365 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsttl" event={"ID":"b9639017-906c-415c-afc6-992d4eecd3d5","Type":"ContainerDied","Data":"5f3940cbe0cf980cd15f298bc6b60ce0ed523dd0006b6135a468d3c9a6f055fb"} Sep 09 20:12:26.423768 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:26.423689 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"caba5047353656bdac3b9b5c41054f4440dde58148f23745b836710fce123046"} Sep 09 20:12:26.426622 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:26.426540 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"535954dac24b8e806fe09df0e24635307bf2ddbc304175a166c2f155f83be5b3"} Sep 09 20:12:27.433972 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.433925 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsttl" event={"ID":"b9639017-906c-415c-afc6-992d4eecd3d5","Type":"ContainerStarted","Data":"e951ba3e10894f00550f7ac58b8f983483340bbdc8eeba9cf84babe6273ac455"} Sep 09 20:12:27.434413 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.434018 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsttl" event={"ID":"b9639017-906c-415c-afc6-992d4eecd3d5","Type":"ContainerStarted","Data":"40303b3ecb8a9cb784ae50fed812d822ebd3bfd876dba5312ae47bcb6afc65fb"} Sep 09 20:12:27.435879 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.435852 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="2a64881c89c8ca24c6ea98ccc0b85bf64cda94d6a53c297d23d30833e2d91e9b" exitCode=0 Sep 09 20:12:27.436004 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.435919 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"2a64881c89c8ca24c6ea98ccc0b85bf64cda94d6a53c297d23d30833e2d91e9b"} Sep 09 20:12:27.453988 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.453948 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bsttl" podStartSLOduration=3.304212168 podStartE2EDuration="4.453934391s" totalImagesPullingTime="1.073838206s" totalInitContainerRuntime="75.884017ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:27.45389492 +0000 UTC m=+78.986212884" watchObservedRunningTime="2026-09-09 20:12:27.453934391 +0000 UTC m=+78.986252354" Sep 09 20:12:27.637315 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.637285 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85c85fc646-jbj5b"] Sep 09 20:12:27.640635 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.640612 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.643952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.643540 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 20:12:27.643952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.643594 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 20:12:27.643952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.643551 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 20:12:27.643952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.643626 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 20:12:27.643952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.643630 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bshbq\"" Sep 09 20:12:27.643952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.643743 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-anjclj4gc19kb\"" Sep 09 20:12:27.651202 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.651178 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85c85fc646-jbj5b"] Sep 09 20:12:27.795345 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795264 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/83a071d3-643a-4c9f-94b9-b938cd7bdda6-metrics-server-audit-profiles\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.795345 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795308 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-secret-metrics-server-tls\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.795548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795348 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/83a071d3-643a-4c9f-94b9-b938cd7bdda6-audit-log\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.795548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795380 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-client-ca-bundle\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.795548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795404 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-secret-metrics-server-client-certs\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.795548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795449 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83a071d3-643a-4c9f-94b9-b938cd7bdda6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.795548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.795481 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggdck\" (UniqueName: \"kubernetes.io/projected/83a071d3-643a-4c9f-94b9-b938cd7bdda6-kube-api-access-ggdck\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896001 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.895971 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83a071d3-643a-4c9f-94b9-b938cd7bdda6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896001 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896014 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggdck\" (UniqueName: \"kubernetes.io/projected/83a071d3-643a-4c9f-94b9-b938cd7bdda6-kube-api-access-ggdck\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896230 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896066 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/83a071d3-643a-4c9f-94b9-b938cd7bdda6-metrics-server-audit-profiles\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896230 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896100 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-secret-metrics-server-tls\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896230 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896142 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/83a071d3-643a-4c9f-94b9-b938cd7bdda6-audit-log\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896230 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896176 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-client-ca-bundle\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896230 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896203 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-secret-metrics-server-client-certs\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896808 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896760 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83a071d3-643a-4c9f-94b9-b938cd7bdda6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.896938 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.896834 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/83a071d3-643a-4c9f-94b9-b938cd7bdda6-audit-log\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.897723 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.897701 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/83a071d3-643a-4c9f-94b9-b938cd7bdda6-metrics-server-audit-profiles\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.899152 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.899126 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-secret-metrics-server-tls\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.899283 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.899265 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-secret-metrics-server-client-certs\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.899984 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.899943 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83a071d3-643a-4c9f-94b9-b938cd7bdda6-client-ca-bundle\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.905292 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.905248 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggdck\" (UniqueName: \"kubernetes.io/projected/83a071d3-643a-4c9f-94b9-b938cd7bdda6-kube-api-access-ggdck\") pod \"metrics-server-85c85fc646-jbj5b\" (UID: \"83a071d3-643a-4c9f-94b9-b938cd7bdda6\") " pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:27.952163 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:27.952137 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:28.446887 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:28.446778 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"76c3ee1074ae850a1d62cee8432258c5d7a5b7786ea1d82c4c93e0c90b441a62"} Sep 09 20:12:28.544345 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:28.544293 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85c85fc646-jbj5b"] Sep 09 20:12:28.547604 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:28.547567 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a071d3_643a_4c9f_94b9_b938cd7bdda6.slice/crio-c7efc28e92fe0ff2cc4adbcf43751f0b0fe0a3138613ee4871d37b9cbaa4682a WatchSource:0}: Error finding container c7efc28e92fe0ff2cc4adbcf43751f0b0fe0a3138613ee4871d37b9cbaa4682a: Status 404 returned error can't find the container with id c7efc28e92fe0ff2cc4adbcf43751f0b0fe0a3138613ee4871d37b9cbaa4682a Sep 09 20:12:29.452712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.452673 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" event={"ID":"83a071d3-643a-4c9f-94b9-b938cd7bdda6","Type":"ContainerStarted","Data":"c7efc28e92fe0ff2cc4adbcf43751f0b0fe0a3138613ee4871d37b9cbaa4682a"} Sep 09 20:12:29.455752 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.455723 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"6ba786a783dfd52fa4927ae8981588b44290f9d694ea084b041e0f51ce3a84c1"} Sep 09 20:12:29.455902 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.455818 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"c37229e2be61954a2c5fbaa3799d93cb3cdd8833c1d6adce408905427ec68159"} Sep 09 20:12:29.514980 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.513144 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:12:29.518611 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.517192 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.521887 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.521868 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 20:12:29.522286 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.522269 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r6cn9\"" Sep 09 20:12:29.522616 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.522601 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 20:12:29.522877 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.522630 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a3hona8aiqph\"" Sep 09 20:12:29.526436 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.523894 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 20:12:29.526436 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.524129 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 20:12:29.526436 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.525117 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 20:12:29.526436 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.525317 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 20:12:29.526682 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.526540 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 20:12:29.526969 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.526949 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 20:12:29.527085 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.527024 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 20:12:29.527670 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.527140 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 20:12:29.527670 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.527157 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 20:12:29.527670 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.527246 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 20:12:29.527670 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.527360 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 20:12:29.527670 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.527431 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 20:12:29.536393 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.536346 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:12:29.614909 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.614854 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.614915 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.614943 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.614969 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fltfz\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-kube-api-access-fltfz\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615001 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-config\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615026 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615053 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-web-config\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615081 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615079 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615105 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615137 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615172 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-config-out\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615208 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615246 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615276 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615307 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615338 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615385 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615412 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615446 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615441 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.615995 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.615492 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716220 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716126 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716220 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716187 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716220 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716218 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716250 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716280 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716320 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716346 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716375 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716422 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716448 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716473 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.716493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716488 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716502 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fltfz\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-kube-api-access-fltfz\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716524 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-config\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716550 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716574 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-web-config\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716599 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716621 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716641 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716666 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-config-out\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.717020 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.716995 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.718270 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.718214 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.718942 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.718918 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.719036 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.718946 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.721453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.719525 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.721453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.719707 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-config-out\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.721453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.720523 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.721453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.721284 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.721453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.721320 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.722491 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.722470 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.724825 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.724783 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.725750 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.725705 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-web-config\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.726845 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.726783 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.727696 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.727633 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.728030 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.728006 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-config\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.729180 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.728453 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.729180 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.728734 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.729180 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.729132 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.730855 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.730721 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fltfz\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-kube-api-access-fltfz\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.731378 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.731340 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:29.832229 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:29.831986 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:30.466110 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:30.465982 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"f2f0197f454456548af640d0e1c33a69cea477c889425a209888c8b213eaf48e"} Sep 09 20:12:30.466110 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:30.466055 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"db2148d2caa9373110fdf1b6932abe00df850a9d3085469b5f95c776d61f508a"} Sep 09 20:12:30.471360 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:30.471241 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"725e9755841fed4c9c62fd1661815a726e38c0ab706563220c937fc631eb2520"} Sep 09 20:12:30.474652 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:30.474135 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" event={"ID":"83a071d3-643a-4c9f-94b9-b938cd7bdda6","Type":"ContainerStarted","Data":"b7e64393b96e7dc38aa71c690351d9017d9eac50abd624fc5abb2371206bf0c2"} Sep 09 20:12:30.494478 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:30.494075 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" podStartSLOduration=1.762913324 podStartE2EDuration="3.494055363s" totalImagesPullingTime="1.731142039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:30.494019801 +0000 UTC m=+82.026337766" watchObservedRunningTime="2026-09-09 20:12:30.494055363 +0000 UTC m=+82.026373327" Sep 09 20:12:30.581245 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:30.581189 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:12:30.584637 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:12:30.584611 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0806da45_8a97_458a_b59b_1429778aa156.slice/crio-3e32e4ee642d949038d5b1b5a3dabebf2793b8a00b8485ab515fd5592d2042b9 WatchSource:0}: Error finding container 3e32e4ee642d949038d5b1b5a3dabebf2793b8a00b8485ab515fd5592d2042b9: Status 404 returned error can't find the container with id 3e32e4ee642d949038d5b1b5a3dabebf2793b8a00b8485ab515fd5592d2042b9 Sep 09 20:12:31.342692 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.342661 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c57969f4c-bc8c5" Sep 09 20:12:31.482650 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.482603 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" event={"ID":"45807f1c-3bdf-4e57-9caf-4b94080b3729","Type":"ContainerStarted","Data":"cdc38135b782f15a22432dc7569addeac368b77811a992855ab02fe49020a403"} Sep 09 20:12:31.483099 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.482736 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:31.484505 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.484477 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18" exitCode=0 Sep 09 20:12:31.484644 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.484577 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18"} Sep 09 20:12:31.484711 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.484656 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"3e32e4ee642d949038d5b1b5a3dabebf2793b8a00b8485ab515fd5592d2042b9"} Sep 09 20:12:31.489207 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.489171 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"d82107916ad0271cb7d8fa79e00534a984b5d7b4e7bb1053f6db636ca4643032"} Sep 09 20:12:31.489310 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.489238 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"ec08b7aa0a7e7569147ba1a0d24f554f8b1f0243a9ec2ae9040500d094208d6d"} Sep 09 20:12:31.489310 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.489289 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"c8e80cad52a2f82848af0e9b005972bccd525754707929b59bb677e57dd69cb1"} Sep 09 20:12:31.489419 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.489336 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"2b714a5656b4780e33aa32d7dc92f6a92edc976b77a9c007e91f69a3e7b4a4d8"} Sep 09 20:12:31.489419 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.489379 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerStarted","Data":"281ba41ddde78ab4991a86a2a803c264bcdc9c6f263e432ec7463249ae7b4bb8"} Sep 09 20:12:31.504879 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.504843 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" podStartSLOduration=2.354231794 podStartE2EDuration="6.504828813s" totalImagesPullingTime="4.150597019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:31.503835544 +0000 UTC m=+83.036153519" watchObservedRunningTime="2026-09-09 20:12:31.504828813 +0000 UTC m=+83.037146777" Sep 09 20:12:31.529105 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:31.529060 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.429617894 podStartE2EDuration="7.52904525s" totalImagesPullingTime="4.079890475s" totalInitContainerRuntime="19.536881ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:31.527577652 +0000 UTC m=+83.059895617" watchObservedRunningTime="2026-09-09 20:12:31.52904525 +0000 UTC m=+83.061363235" Sep 09 20:12:37.500393 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:37.500356 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dfbbdb46f-f6kdt" Sep 09 20:12:38.523605 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:38.523568 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-6nlwc" event={"ID":"03baae22-0917-4aa4-b16b-245211440de0","Type":"ContainerStarted","Data":"a9b3df80ba242927d86c5f5d83d28b52d688221b213613415ac5d0f180cb7c21"} Sep 09 20:12:38.524060 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:38.523770 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:38.525553 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:38.525525 2541 patch_prober.go:28] interesting pod/downloads-85d98c998f-6nlwc container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Sep 09 20:12:38.525676 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:38.525601 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-6nlwc" podUID="03baae22-0917-4aa4-b16b-245211440de0" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Sep 09 20:12:38.542565 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:38.542514 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-6nlwc" podStartSLOduration=3.027862339 podStartE2EDuration="20.542495456s" totalImagesPullingTime="17.514633117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:38.540525203 +0000 UTC m=+90.072843168" watchObservedRunningTime="2026-09-09 20:12:38.542495456 +0000 UTC m=+90.074813423" Sep 09 20:12:39.532757 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:39.532722 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-6nlwc" Sep 09 20:12:42.547060 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.546988 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42"} Sep 09 20:12:42.547060 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.547058 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63"} Sep 09 20:12:42.547495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.547088 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce"} Sep 09 20:12:42.547495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.547117 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2"} Sep 09 20:12:42.547495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.547151 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd"} Sep 09 20:12:42.547495 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.547175 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerStarted","Data":"7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264"} Sep 09 20:12:42.577773 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:42.577715 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.289049956 podStartE2EDuration="13.577693259s" totalImagesPullingTime="10.262544198s" totalInitContainerRuntime="26.099105ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:42.574849251 +0000 UTC m=+94.107167216" watchObservedRunningTime="2026-09-09 20:12:42.577693259 +0000 UTC m=+94.110011225" Sep 09 20:12:44.832252 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:44.832212 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:12:47.953231 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:47.953192 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:47.953727 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:47.953280 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:12:52.399082 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:12:52.399053 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-89nn6" Sep 09 20:13:07.958532 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:07.958495 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:13:07.962539 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:07.962514 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85c85fc646-jbj5b" Sep 09 20:13:29.832660 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:29.832623 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:29.861968 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:29.861599 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:30.760024 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:30.759995 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:43.648461 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648427 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:13:43.648994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648701 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="alertmanager" containerID="cri-o://725e9755841fed4c9c62fd1661815a726e38c0ab706563220c937fc631eb2520" gracePeriod=120 Sep 09 20:13:43.648994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648776 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-web" containerID="cri-o://281ba41ddde78ab4991a86a2a803c264bcdc9c6f263e432ec7463249ae7b4bb8" gracePeriod=120 Sep 09 20:13:43.648994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648773 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-metric" containerID="cri-o://c8e80cad52a2f82848af0e9b005972bccd525754707929b59bb677e57dd69cb1" gracePeriod=120 Sep 09 20:13:43.648994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648831 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy" containerID="cri-o://2b714a5656b4780e33aa32d7dc92f6a92edc976b77a9c007e91f69a3e7b4a4d8" gracePeriod=120 Sep 09 20:13:43.648994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648865 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="config-reloader" containerID="cri-o://d82107916ad0271cb7d8fa79e00534a984b5d7b4e7bb1053f6db636ca4643032" gracePeriod=120 Sep 09 20:13:43.649232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.648995 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="prom-label-proxy" containerID="cri-o://ec08b7aa0a7e7569147ba1a0d24f554f8b1f0243a9ec2ae9040500d094208d6d" gracePeriod=120 Sep 09 20:13:43.801176 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801155 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="ec08b7aa0a7e7569147ba1a0d24f554f8b1f0243a9ec2ae9040500d094208d6d" exitCode=0 Sep 09 20:13:43.801176 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801174 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="2b714a5656b4780e33aa32d7dc92f6a92edc976b77a9c007e91f69a3e7b4a4d8" exitCode=0 Sep 09 20:13:43.801307 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801182 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="d82107916ad0271cb7d8fa79e00534a984b5d7b4e7bb1053f6db636ca4643032" exitCode=0 Sep 09 20:13:43.801307 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801188 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="725e9755841fed4c9c62fd1661815a726e38c0ab706563220c937fc631eb2520" exitCode=0 Sep 09 20:13:43.801307 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801235 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"ec08b7aa0a7e7569147ba1a0d24f554f8b1f0243a9ec2ae9040500d094208d6d"} Sep 09 20:13:43.801307 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801298 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"2b714a5656b4780e33aa32d7dc92f6a92edc976b77a9c007e91f69a3e7b4a4d8"} Sep 09 20:13:43.801422 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801325 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"d82107916ad0271cb7d8fa79e00534a984b5d7b4e7bb1053f6db636ca4643032"} Sep 09 20:13:43.801422 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:43.801349 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"725e9755841fed4c9c62fd1661815a726e38c0ab706563220c937fc631eb2520"} Sep 09 20:13:44.810215 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.810186 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="c8e80cad52a2f82848af0e9b005972bccd525754707929b59bb677e57dd69cb1" exitCode=0 Sep 09 20:13:44.810215 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.810212 2541 generic.go:356] "Generic (PLEG): container finished" podID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerID="281ba41ddde78ab4991a86a2a803c264bcdc9c6f263e432ec7463249ae7b4bb8" exitCode=0 Sep 09 20:13:44.810689 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.810239 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"c8e80cad52a2f82848af0e9b005972bccd525754707929b59bb677e57dd69cb1"} Sep 09 20:13:44.810689 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.810300 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"281ba41ddde78ab4991a86a2a803c264bcdc9c6f263e432ec7463249ae7b4bb8"} Sep 09 20:13:44.894729 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.894710 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:44.945465 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945444 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-tls-assets\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945477 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945494 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945542 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945583 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-out\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945623 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945652 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-main-db\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945682 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-metrics-client-ca\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945715 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945744 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-volume\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945782 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-web-config\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.945857 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945831 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94tfb\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-kube-api-access-94tfb\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.946198 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.945883 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-cluster-tls-config\") pod \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\" (UID: \"4eacbd0a-160a-4afa-ae51-c74de745d5a2\") " Sep 09 20:13:44.946198 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.946088 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:13:44.947033 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.946599 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:44.947033 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.947001 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:44.949916 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.949873 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:44.950009 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.949933 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-kube-api-access-94tfb" (OuterVolumeSpecName: "kube-api-access-94tfb") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "kube-api-access-94tfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:13:44.950233 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.950205 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-out" (OuterVolumeSpecName: "config-out") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:13:44.950233 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.950224 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-volume" (OuterVolumeSpecName: "config-volume") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:44.950417 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.950360 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:44.950512 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.950490 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:13:44.950656 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.950635 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:44.951860 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.951780 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:44.955403 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.955375 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:44.962181 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:44.962159 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-web-config" (OuterVolumeSpecName: "web-config") pod "4eacbd0a-160a-4afa-ae51-c74de745d5a2" (UID: "4eacbd0a-160a-4afa-ae51-c74de745d5a2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:45.046548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046526 2541 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-web-config\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046547 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94tfb\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-kube-api-access-94tfb\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046557 2541 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-cluster-tls-config\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046566 2541 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4eacbd0a-160a-4afa-ae51-c74de745d5a2-tls-assets\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046576 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046585 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-main-tls\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046594 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046602 2541 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-out\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046610 2541 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046617 2541 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4eacbd0a-160a-4afa-ae51-c74de745d5a2-alertmanager-main-db\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046625 2541 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eacbd0a-160a-4afa-ae51-c74de745d5a2-metrics-client-ca\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046634 2541 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.046665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.046641 2541 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4eacbd0a-160a-4afa-ae51-c74de745d5a2-config-volume\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:45.817575 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.817546 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4eacbd0a-160a-4afa-ae51-c74de745d5a2","Type":"ContainerDied","Data":"caba5047353656bdac3b9b5c41054f4440dde58148f23745b836710fce123046"} Sep 09 20:13:45.817945 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.817581 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.817945 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.817629 2541 scope.go:117] "RemoveContainer" containerID="ec08b7aa0a7e7569147ba1a0d24f554f8b1f0243a9ec2ae9040500d094208d6d" Sep 09 20:13:45.826566 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.826548 2541 scope.go:117] "RemoveContainer" containerID="c8e80cad52a2f82848af0e9b005972bccd525754707929b59bb677e57dd69cb1" Sep 09 20:13:45.833235 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.833219 2541 scope.go:117] "RemoveContainer" containerID="2b714a5656b4780e33aa32d7dc92f6a92edc976b77a9c007e91f69a3e7b4a4d8" Sep 09 20:13:45.840533 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.840513 2541 scope.go:117] "RemoveContainer" containerID="281ba41ddde78ab4991a86a2a803c264bcdc9c6f263e432ec7463249ae7b4bb8" Sep 09 20:13:45.841249 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.841225 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:13:45.846149 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.846127 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:13:45.848011 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.847997 2541 scope.go:117] "RemoveContainer" containerID="d82107916ad0271cb7d8fa79e00534a984b5d7b4e7bb1053f6db636ca4643032" Sep 09 20:13:45.854701 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.854684 2541 scope.go:117] "RemoveContainer" containerID="725e9755841fed4c9c62fd1661815a726e38c0ab706563220c937fc631eb2520" Sep 09 20:13:45.861368 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.861352 2541 scope.go:117] "RemoveContainer" containerID="2a64881c89c8ca24c6ea98ccc0b85bf64cda94d6a53c297d23d30833e2d91e9b" Sep 09 20:13:45.874352 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874333 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:13:45.874596 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874584 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874597 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874605 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-metric" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874610 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-metric" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874618 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="prom-label-proxy" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874623 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="prom-label-proxy" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874638 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-web" Sep 09 20:13:45.874643 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874643 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-web" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874649 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="config-reloader" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874654 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="config-reloader" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874660 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="init-config-reloader" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874666 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="init-config-reloader" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874671 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="alertmanager" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874676 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="alertmanager" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874718 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="config-reloader" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874725 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-metric" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874733 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy-web" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874739 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="prom-label-proxy" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874744 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="alertmanager" Sep 09 20:13:45.874885 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.874749 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" containerName="kube-rbac-proxy" Sep 09 20:13:45.880753 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.880731 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.883862 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.883843 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 20:13:45.883973 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.883846 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 20:13:45.883973 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.883936 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 20:13:45.883973 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.883943 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 20:13:45.884132 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.883977 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 20:13:45.884184 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.884129 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 20:13:45.884235 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.884191 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 20:13:45.884235 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.884199 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-875zc\"" Sep 09 20:13:45.884484 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.884470 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 20:13:45.890178 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.890162 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 20:13:45.897915 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.897898 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:13:45.952786 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952763 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e7ea223-bfd8-4b98-96b8-66920e263919-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.952906 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952811 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e7ea223-bfd8-4b98-96b8-66920e263919-config-out\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.952906 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952829 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-config-volume\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.952906 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952846 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.952906 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952899 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-web-config\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952928 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7ea223-bfd8-4b98-96b8-66920e263919-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952948 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952967 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.952985 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.953000 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nrbp\" (UniqueName: \"kubernetes.io/projected/9e7ea223-bfd8-4b98-96b8-66920e263919-kube-api-access-6nrbp\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.953016 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e7ea223-bfd8-4b98-96b8-66920e263919-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953071 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.953059 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9e7ea223-bfd8-4b98-96b8-66920e263919-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:45.953291 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:45.953143 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053432 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053385 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-web-config\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053432 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053428 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7ea223-bfd8-4b98-96b8-66920e263919-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053583 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053473 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053583 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053491 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053636 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053665 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nrbp\" (UniqueName: \"kubernetes.io/projected/9e7ea223-bfd8-4b98-96b8-66920e263919-kube-api-access-6nrbp\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053690 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e7ea223-bfd8-4b98-96b8-66920e263919-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053713 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9e7ea223-bfd8-4b98-96b8-66920e263919-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053824 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.053895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053879 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e7ea223-bfd8-4b98-96b8-66920e263919-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.054034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053924 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e7ea223-bfd8-4b98-96b8-66920e263919-config-out\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.054034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053954 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-config-volume\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.054034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.053982 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.054034 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.054024 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9e7ea223-bfd8-4b98-96b8-66920e263919-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.054728 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.054403 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7ea223-bfd8-4b98-96b8-66920e263919-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.055390 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.055129 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e7ea223-bfd8-4b98-96b8-66920e263919-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.056963 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.056938 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.057141 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.057071 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.057434 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.057410 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e7ea223-bfd8-4b98-96b8-66920e263919-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.057548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.057523 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.057548 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.057542 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-config-volume\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.057677 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.057659 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.057957 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.057936 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-web-config\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.058663 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.058648 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e7ea223-bfd8-4b98-96b8-66920e263919-config-out\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.059368 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.059345 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9e7ea223-bfd8-4b98-96b8-66920e263919-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.062709 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.062687 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nrbp\" (UniqueName: \"kubernetes.io/projected/9e7ea223-bfd8-4b98-96b8-66920e263919-kube-api-access-6nrbp\") pod \"alertmanager-main-0\" (UID: \"9e7ea223-bfd8-4b98-96b8-66920e263919\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.190000 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.189979 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:13:46.470963 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.470934 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:13:46.472387 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:13:46.472364 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7ea223_bfd8_4b98_96b8_66920e263919.slice/crio-048835c02a7647e4152c2d5198d811a42c3809a9cfe99e4c8bcfbfa355984e78 WatchSource:0}: Error finding container 048835c02a7647e4152c2d5198d811a42c3809a9cfe99e4c8bcfbfa355984e78: Status 404 returned error can't find the container with id 048835c02a7647e4152c2d5198d811a42c3809a9cfe99e4c8bcfbfa355984e78 Sep 09 20:13:46.823971 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.823935 2541 generic.go:356] "Generic (PLEG): container finished" podID="9e7ea223-bfd8-4b98-96b8-66920e263919" containerID="447ded06218ab641b744c072f97d66a7c5f8e0fc6abb5b9f87ed049b61886867" exitCode=0 Sep 09 20:13:46.824277 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.823977 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerDied","Data":"447ded06218ab641b744c072f97d66a7c5f8e0fc6abb5b9f87ed049b61886867"} Sep 09 20:13:46.824277 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.824041 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"048835c02a7647e4152c2d5198d811a42c3809a9cfe99e4c8bcfbfa355984e78"} Sep 09 20:13:46.944738 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:46.944714 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eacbd0a-160a-4afa-ae51-c74de745d5a2" path="/var/lib/kubelet/pods/4eacbd0a-160a-4afa-ae51-c74de745d5a2/volumes" Sep 09 20:13:47.831391 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.831356 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"7330c76b4d0cceaf4e978ceb5f3df944280593bfe1888edf72de03e76509ec41"} Sep 09 20:13:47.831847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.831429 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"81c1557c4dab76b2dc4051d7846e244c7e2af4ec86e65d619e3329f06177b5ae"} Sep 09 20:13:47.831847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.831459 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"0e5317f15671041b3475644069e2eaa122a203e9e8397355302003cf08fe5ad5"} Sep 09 20:13:47.831847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.831485 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"e7d4de391ec018885d778d66eba17dcbe3b834ba507adcfc1cb3598ae8264bbb"} Sep 09 20:13:47.831847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.831511 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"9ce996d290f1f00f8b0e999dd28f95ee1bb1dfcc4d2891039b884e628583a1c9"} Sep 09 20:13:47.831847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.831538 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e7ea223-bfd8-4b98-96b8-66920e263919","Type":"ContainerStarted","Data":"868f04610a0a531082cdc654abfe7037a48a301bf6d8358e1ca04835995c8854"} Sep 09 20:13:47.864061 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.864002 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.84689479 podStartE2EDuration="2.863980552s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.085762ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:13:47.858149198 +0000 UTC m=+159.390467163" watchObservedRunningTime="2026-09-09 20:13:47.863980552 +0000 UTC m=+159.396298517" Sep 09 20:13:47.898939 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.898906 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:13:47.899222 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.899193 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="prometheus" containerID="cri-o://7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264" gracePeriod=600 Sep 09 20:13:47.899303 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.899219 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="thanos-sidecar" containerID="cri-o://4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2" gracePeriod=600 Sep 09 20:13:47.899303 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.899222 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-thanos" containerID="cri-o://92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42" gracePeriod=600 Sep 09 20:13:47.899303 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.899228 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-web" containerID="cri-o://ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce" gracePeriod=600 Sep 09 20:13:47.899303 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.899259 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy" containerID="cri-o://3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63" gracePeriod=600 Sep 09 20:13:47.900382 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:47.899606 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="config-reloader" containerID="cri-o://8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd" gracePeriod=600 Sep 09 20:13:48.840335 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840297 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42" exitCode=0 Sep 09 20:13:48.840335 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840326 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63" exitCode=0 Sep 09 20:13:48.840335 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840333 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2" exitCode=0 Sep 09 20:13:48.840335 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840340 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd" exitCode=0 Sep 09 20:13:48.840871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840348 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264" exitCode=0 Sep 09 20:13:48.840871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840373 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42"} Sep 09 20:13:48.840871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840469 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63"} Sep 09 20:13:48.840871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840514 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2"} Sep 09 20:13:48.840871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840557 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd"} Sep 09 20:13:48.840871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:48.840596 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264"} Sep 09 20:13:49.138267 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.138241 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.180278 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180253 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-config-out\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180303 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-metrics-client-certs\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180324 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-2\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180344 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-web-config\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180362 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fltfz\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-kube-api-access-fltfz\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180384 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-metrics-client-ca\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180408 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-trusted-ca-bundle\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180431 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180462 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-1\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180496 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180495 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-kubelet-serving-ca-bundle\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180520 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-kube-rbac-proxy\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180561 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-db\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180597 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-tls\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180631 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-0\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180677 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-thanos-prometheus-http-client-file\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180693 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180709 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-config\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180757 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-tls-assets\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180808 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-grpc-tls\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180832 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-serving-certs-ca-bundle\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.180994 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.180856 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0806da45-8a97-458a-b59b-1429778aa156\" (UID: \"0806da45-8a97-458a-b59b-1429778aa156\") " Sep 09 20:13:49.181706 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.181010 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.181706 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.181315 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.181706 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.181336 2541 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-metrics-client-ca\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.181706 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.181362 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.181936 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.181868 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.182077 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.182050 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.182763 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.182734 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.183133 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.183105 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:13:49.184988 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.184964 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:13:49.185558 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.185453 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.185558 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.185532 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.185970 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.185943 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:13:49.186517 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.186487 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.186622 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.186567 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.186622 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.186582 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.186744 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.186688 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-config-out" (OuterVolumeSpecName: "config-out") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:13:49.186916 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.186893 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-kube-api-access-fltfz" (OuterVolumeSpecName: "kube-api-access-fltfz") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "kube-api-access-fltfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:13:49.187069 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.187049 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.187708 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.187675 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-config" (OuterVolumeSpecName: "config") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.188531 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.188510 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.197999 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.197980 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-web-config" (OuterVolumeSpecName: "web-config") pod "0806da45-8a97-458a-b59b-1429778aa156" (UID: "0806da45-8a97-458a-b59b-1429778aa156"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:13:49.282278 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282221 2541 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-metrics-client-certs\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282278 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282244 2541 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-web-config\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282278 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282264 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fltfz\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-kube-api-access-fltfz\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282278 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282272 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282282 2541 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282290 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282299 2541 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282308 2541 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-kube-rbac-proxy\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282316 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-db\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282325 2541 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282333 2541 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282342 2541 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282350 2541 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-config\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282358 2541 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0806da45-8a97-458a-b59b-1429778aa156-tls-assets\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282366 2541 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-grpc-tls\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282373 2541 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0806da45-8a97-458a-b59b-1429778aa156-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282381 2541 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0806da45-8a97-458a-b59b-1429778aa156-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.282453 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.282390 2541 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0806da45-8a97-458a-b59b-1429778aa156-config-out\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:13:49.848511 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.848480 2541 generic.go:356] "Generic (PLEG): container finished" podID="0806da45-8a97-458a-b59b-1429778aa156" containerID="ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce" exitCode=0 Sep 09 20:13:49.848907 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.848535 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce"} Sep 09 20:13:49.848907 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.848566 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.848907 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.848628 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0806da45-8a97-458a-b59b-1429778aa156","Type":"ContainerDied","Data":"3e32e4ee642d949038d5b1b5a3dabebf2793b8a00b8485ab515fd5592d2042b9"} Sep 09 20:13:49.848907 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.848700 2541 scope.go:117] "RemoveContainer" containerID="92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42" Sep 09 20:13:49.858410 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.858390 2541 scope.go:117] "RemoveContainer" containerID="3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63" Sep 09 20:13:49.866585 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.866566 2541 scope.go:117] "RemoveContainer" containerID="ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce" Sep 09 20:13:49.875493 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.874309 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:13:49.876249 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.876125 2541 scope.go:117] "RemoveContainer" containerID="4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2" Sep 09 20:13:49.879665 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.879642 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:13:49.884353 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.884335 2541 scope.go:117] "RemoveContainer" containerID="8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd" Sep 09 20:13:49.891421 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.891400 2541 scope.go:117] "RemoveContainer" containerID="7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264" Sep 09 20:13:49.899302 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.899283 2541 scope.go:117] "RemoveContainer" containerID="d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18" Sep 09 20:13:49.905451 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905430 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:13:49.905722 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905710 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-thanos" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905724 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-thanos" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905732 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-web" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905738 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-web" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905746 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="init-config-reloader" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905751 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="init-config-reloader" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905762 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy" Sep 09 20:13:49.905767 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905768 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905778 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="prometheus" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905783 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="prometheus" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905808 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="thanos-sidecar" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905813 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="thanos-sidecar" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905821 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="config-reloader" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905826 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="config-reloader" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905868 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905875 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-thanos" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905881 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="kube-rbac-proxy-web" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905887 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="thanos-sidecar" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905893 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="config-reloader" Sep 09 20:13:49.905986 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.905899 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="0806da45-8a97-458a-b59b-1429778aa156" containerName="prometheus" Sep 09 20:13:49.907006 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.906990 2541 scope.go:117] "RemoveContainer" containerID="92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42" Sep 09 20:13:49.907327 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.907305 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42\": container with ID starting with 92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42 not found: ID does not exist" containerID="92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42" Sep 09 20:13:49.907425 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.907333 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42"} err="failed to get container status \"92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42\": rpc error: code = NotFound desc = could not find container \"92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42\": container with ID starting with 92e7acd009ace9f5dd43a01b82661fbdde9f206652aecb23b070f2d034e52b42 not found: ID does not exist" Sep 09 20:13:49.907425 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.907365 2541 scope.go:117] "RemoveContainer" containerID="3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63" Sep 09 20:13:49.907648 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.907629 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63\": container with ID starting with 3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63 not found: ID does not exist" containerID="3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63" Sep 09 20:13:49.907712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.907658 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63"} err="failed to get container status \"3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63\": rpc error: code = NotFound desc = could not find container \"3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63\": container with ID starting with 3f7a9b8d404dcb06cc859bb568564bc83fa6feaee67ad357fe4248f0c3a17c63 not found: ID does not exist" Sep 09 20:13:49.907712 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.907682 2541 scope.go:117] "RemoveContainer" containerID="ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce" Sep 09 20:13:49.907999 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.907979 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce\": container with ID starting with ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce not found: ID does not exist" containerID="ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce" Sep 09 20:13:49.908094 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908005 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce"} err="failed to get container status \"ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce\": rpc error: code = NotFound desc = could not find container \"ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce\": container with ID starting with ffa9581f5f5e01d5632159df6a9495f45e3d4baf5a9d786b77b1164b844e3cce not found: ID does not exist" Sep 09 20:13:49.908094 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908024 2541 scope.go:117] "RemoveContainer" containerID="4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2" Sep 09 20:13:49.908303 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.908283 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2\": container with ID starting with 4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2 not found: ID does not exist" containerID="4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2" Sep 09 20:13:49.908350 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908308 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2"} err="failed to get container status \"4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2\": rpc error: code = NotFound desc = could not find container \"4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2\": container with ID starting with 4346de972dcb239fbd2be928e77a8f3ae7ba773403bb3f8aa9928198933648f2 not found: ID does not exist" Sep 09 20:13:49.908350 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908323 2541 scope.go:117] "RemoveContainer" containerID="8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd" Sep 09 20:13:49.908560 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.908544 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd\": container with ID starting with 8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd not found: ID does not exist" containerID="8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd" Sep 09 20:13:49.908625 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908567 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd"} err="failed to get container status \"8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd\": rpc error: code = NotFound desc = could not find container \"8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd\": container with ID starting with 8ef64c432a3009e53564bddf9f430aeffb27cf3bb266843e056a638a8a35c6cd not found: ID does not exist" Sep 09 20:13:49.908625 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908587 2541 scope.go:117] "RemoveContainer" containerID="7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264" Sep 09 20:13:49.908845 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.908825 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264\": container with ID starting with 7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264 not found: ID does not exist" containerID="7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264" Sep 09 20:13:49.908889 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908850 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264"} err="failed to get container status \"7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264\": rpc error: code = NotFound desc = could not find container \"7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264\": container with ID starting with 7577fb2eaa918204b80331b803f3a87b05a7b81cbcb9613ff5ee05439bc15264 not found: ID does not exist" Sep 09 20:13:49.909268 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.908864 2541 scope.go:117] "RemoveContainer" containerID="d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18" Sep 09 20:13:49.909517 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.909498 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.910485 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:13:49.909991 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18\": container with ID starting with d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18 not found: ID does not exist" containerID="d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18" Sep 09 20:13:49.910485 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.910029 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18"} err="failed to get container status \"d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18\": rpc error: code = NotFound desc = could not find container \"d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18\": container with ID starting with d954dd5ac2aed983a4fb91b6d2d157bd7e3fc4c21aaaf293b6e9167ad78caa18 not found: ID does not exist" Sep 09 20:13:49.915448 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915426 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 20:13:49.915448 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915431 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 20:13:49.915618 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915449 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 20:13:49.915618 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915561 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a3hona8aiqph\"" Sep 09 20:13:49.915618 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915575 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 20:13:49.915618 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915602 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 20:13:49.915782 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915707 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 20:13:49.915867 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915832 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 20:13:49.915980 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.915960 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 20:13:49.916037 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.916005 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r6cn9\"" Sep 09 20:13:49.916117 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.916097 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 20:13:49.916175 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.916124 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 20:13:49.916175 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.916134 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 20:13:49.916341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.916322 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 20:13:49.918340 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.918322 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 20:13:49.920142 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.920117 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 20:13:49.926367 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.926345 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:13:49.987031 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.986980 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987031 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987015 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987141 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987039 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987141 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987054 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987141 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987127 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987155 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987174 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987195 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987226 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987257 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987274 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987292 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph54l\" (UniqueName: \"kubernetes.io/projected/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-kube-api-access-ph54l\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987331 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987357 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987375 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987396 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987417 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987431 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987445 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-config\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:49.987459 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:49.987458 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088479 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088448 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088479 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088483 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088504 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088523 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088550 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088573 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088599 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088621 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088624 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088978 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088650 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.088978 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.088674 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph54l\" (UniqueName: \"kubernetes.io/projected/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-kube-api-access-ph54l\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.090440 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.090415 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.090625 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.090604 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.090750 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.090732 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.090892 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.090874 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091010 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.090994 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091122 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091106 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091234 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091211 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091336 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091249 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-config\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091336 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091277 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091336 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091311 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091481 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091365 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091699 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091674 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.091871 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.091851 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.092044 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092013 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092243 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092461 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092658 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092765 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092879 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.092995 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.093115 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.093400 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.093569 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.093529 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.094288 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.093916 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.094515 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.094487 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-config\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.094973 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.094951 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.095347 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.095323 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.095440 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.095356 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.095711 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.095694 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.101706 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.101687 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph54l\" (UniqueName: \"kubernetes.io/projected/cb2a5c73-d8f1-4033-8e76-5caa11e05f53-kube-api-access-ph54l\") pod \"prometheus-k8s-0\" (UID: \"cb2a5c73-d8f1-4033-8e76-5caa11e05f53\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.225400 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.225376 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:13:50.501954 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.501927 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:13:50.503123 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:13:50.503096 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2a5c73_d8f1_4033_8e76_5caa11e05f53.slice/crio-f66c660c90000973a5eb122abbdc3a01027f16be7cb6d9401be78ddd66366adc WatchSource:0}: Error finding container f66c660c90000973a5eb122abbdc3a01027f16be7cb6d9401be78ddd66366adc: Status 404 returned error can't find the container with id f66c660c90000973a5eb122abbdc3a01027f16be7cb6d9401be78ddd66366adc Sep 09 20:13:50.854978 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.854946 2541 generic.go:356] "Generic (PLEG): container finished" podID="cb2a5c73-d8f1-4033-8e76-5caa11e05f53" containerID="d7c46b7f313829f52bbf6e7f70192de0b7d8ae7e7e153f26b68852a0834fd388" exitCode=0 Sep 09 20:13:50.855341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.855005 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerDied","Data":"d7c46b7f313829f52bbf6e7f70192de0b7d8ae7e7e153f26b68852a0834fd388"} Sep 09 20:13:50.855341 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.855068 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"f66c660c90000973a5eb122abbdc3a01027f16be7cb6d9401be78ddd66366adc"} Sep 09 20:13:50.946718 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:50.946691 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0806da45-8a97-458a-b59b-1429778aa156" path="/var/lib/kubelet/pods/0806da45-8a97-458a-b59b-1429778aa156/volumes" Sep 09 20:13:51.863222 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.863186 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"ffc567b03723e7c9e0d041791caf23ec0fe1d7351adfc1e87cdd931e2c5b055a"} Sep 09 20:13:51.863660 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.863279 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"3beb3f69b13fa70d55ccd3fb702d3af19f161d126409ca5888e8d8390c32afe7"} Sep 09 20:13:51.863660 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.863305 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"0afcee30fb77a49c3821604128f8a952d7fdd9e9059ff5398905f9d633ba0cd5"} Sep 09 20:13:51.863660 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.863329 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"c3ecea4bb803abd39003c79ffebdf73289c1e3afa50f67cf46c35169f69a653f"} Sep 09 20:13:51.863660 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.863352 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"1ac96e5d00423c4434736a9448990ef15ae67a1828f6916d1d96e0c4d9a9fe34"} Sep 09 20:13:51.863660 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.863374 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb2a5c73-d8f1-4033-8e76-5caa11e05f53","Type":"ContainerStarted","Data":"777b527bed2c88e689449bea00a4c6d226835e8b38439be98c38e90625ec0f95"} Sep 09 20:13:51.891005 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:51.890957 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8700988450000002 podStartE2EDuration="2.890941758s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.842913ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:13:51.888528063 +0000 UTC m=+163.420846028" watchObservedRunningTime="2026-09-09 20:13:51.890941758 +0000 UTC m=+163.423259722" Sep 09 20:13:55.225894 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:13:55.225864 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:14:50.226216 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:14:50.226177 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:14:50.244281 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:14:50.244252 2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:14:51.123346 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:14:51.123320 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:08.895694 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:16:08.895665 2541 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 20:24:45.805714 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.805679 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz"] Sep 09 20:24:45.809132 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.809110 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:45.811527 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.811501 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-f811d-serving-cert\"" Sep 09 20:24:45.811662 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.811501 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-f811d-kube-rbac-proxy-sar-config\"" Sep 09 20:24:45.811662 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.811511 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-f4cxz\"" Sep 09 20:24:45.812408 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.812392 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 09 20:24:45.817068 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.816994 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz"] Sep 09 20:24:45.911347 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.911300 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-proxy-tls\") pod \"model-chainer-raw-f811d-6bf4bc976f-cgwvz\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:45.911347 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:45.911353 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-openshift-service-ca-bundle\") pod \"model-chainer-raw-f811d-6bf4bc976f-cgwvz\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:46.012077 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.012033 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-openshift-service-ca-bundle\") pod \"model-chainer-raw-f811d-6bf4bc976f-cgwvz\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:46.012281 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.012138 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-proxy-tls\") pod \"model-chainer-raw-f811d-6bf4bc976f-cgwvz\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:46.012737 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.012707 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-openshift-service-ca-bundle\") pod \"model-chainer-raw-f811d-6bf4bc976f-cgwvz\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:46.014760 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.014734 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-proxy-tls\") pod \"model-chainer-raw-f811d-6bf4bc976f-cgwvz\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:46.122119 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.122077 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:46.395870 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.395626 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz"] Sep 09 20:24:46.399836 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:24:46.399776 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f99d74_0b73_4cdf_b886_0d94eb2171a5.slice/crio-c4e78162917561b5f9649569f00c7b14545baebd684171abb0838ec4d6a4b004 WatchSource:0}: Error finding container c4e78162917561b5f9649569f00c7b14545baebd684171abb0838ec4d6a4b004: Status 404 returned error can't find the container with id c4e78162917561b5f9649569f00c7b14545baebd684171abb0838ec4d6a4b004 Sep 09 20:24:46.402321 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.402304 2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:24:46.488874 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:46.488839 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" event={"ID":"b6f99d74-0b73-4cdf-b886-0d94eb2171a5","Type":"ContainerStarted","Data":"c4e78162917561b5f9649569f00c7b14545baebd684171abb0838ec4d6a4b004"} Sep 09 20:24:50.508847 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:50.508781 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" event={"ID":"b6f99d74-0b73-4cdf-b886-0d94eb2171a5","Type":"ContainerStarted","Data":"b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3"} Sep 09 20:24:50.509267 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:50.508955 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:24:50.525265 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:50.525193 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podStartSLOduration=2.470791733 podStartE2EDuration="5.525174452s" totalImagesPullingTime="3.054382719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:50.522593965 +0000 UTC m=+822.054911932" watchObservedRunningTime="2026-09-09 20:24:50.525174452 +0000 UTC m=+822.057492416" Sep 09 20:24:55.868967 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:55.868930 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz"] Sep 09 20:24:55.869373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:55.869137 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" containerID="cri-o://b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3" gracePeriod=30 Sep 09 20:24:55.875120 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:24:55.875090 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:00.873653 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:00.873593 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:05.873458 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:05.873420 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:10.873666 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:10.873611 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:15.874267 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:15.874223 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:20.873059 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:20.873018 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:25.873462 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:25.873178 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:25:26.528283 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.528253 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:25:26.570052 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.570022 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-proxy-tls\") pod \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " Sep 09 20:25:26.570252 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.570082 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-openshift-service-ca-bundle\") pod \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\" (UID: \"b6f99d74-0b73-4cdf-b886-0d94eb2171a5\") " Sep 09 20:25:26.570507 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.570470 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b6f99d74-0b73-4cdf-b886-0d94eb2171a5" (UID: "b6f99d74-0b73-4cdf-b886-0d94eb2171a5"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:25:26.572628 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.572598 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b6f99d74-0b73-4cdf-b886-0d94eb2171a5" (UID: "b6f99d74-0b73-4cdf-b886-0d94eb2171a5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:25:26.659219 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.659126 2541 generic.go:356] "Generic (PLEG): container finished" podID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerID="b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3" exitCode=0 Sep 09 20:25:26.659219 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.659173 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" Sep 09 20:25:26.659442 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.659225 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" event={"ID":"b6f99d74-0b73-4cdf-b886-0d94eb2171a5","Type":"ContainerDied","Data":"b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3"} Sep 09 20:25:26.659442 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.659279 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz" event={"ID":"b6f99d74-0b73-4cdf-b886-0d94eb2171a5","Type":"ContainerDied","Data":"c4e78162917561b5f9649569f00c7b14545baebd684171abb0838ec4d6a4b004"} Sep 09 20:25:26.659442 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.659304 2541 scope.go:117] "RemoveContainer" containerID="b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3" Sep 09 20:25:26.668413 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.668392 2541 scope.go:117] "RemoveContainer" containerID="b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3" Sep 09 20:25:26.668705 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:25:26.668689 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3\": container with ID starting with b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3 not found: ID does not exist" containerID="b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3" Sep 09 20:25:26.668753 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.668715 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3"} err="failed to get container status \"b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3\": rpc error: code = NotFound desc = could not find container \"b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3\": container with ID starting with b777b9c97f5d9b8dee4720088855ce049dbc9c54eec8f8a3a9381646346b53f3 not found: ID does not exist" Sep 09 20:25:26.670667 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.670649 2541 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-proxy-tls\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:25:26.670743 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.670668 2541 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f99d74-0b73-4cdf-b886-0d94eb2171a5-openshift-service-ca-bundle\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:25:26.679089 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.679062 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz"] Sep 09 20:25:26.684342 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.684314 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-f811d-6bf4bc976f-cgwvz"] Sep 09 20:25:26.944745 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:25:26.944666 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" path="/var/lib/kubelet/pods/b6f99d74-0b73-4cdf-b886-0d94eb2171a5/volumes" Sep 09 20:26:36.095226 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.095185 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn"] Sep 09 20:26:36.095730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.095533 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" Sep 09 20:26:36.095730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.095546 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" Sep 09 20:26:36.095730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.095604 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f99d74-0b73-4cdf-b886-0d94eb2171a5" containerName="model-chainer-raw-f811d" Sep 09 20:26:36.098653 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.098629 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.101178 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.101151 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-2aad0-kube-rbac-proxy-sar-config\"" Sep 09 20:26:36.101178 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.101170 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 09 20:26:36.101392 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.101219 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-f4cxz\"" Sep 09 20:26:36.101392 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.101279 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-2aad0-serving-cert\"" Sep 09 20:26:36.106944 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.106920 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn"] Sep 09 20:26:36.167389 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.167344 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-2aad0-9f8567df9-dnszn\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.167589 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.167434 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-proxy-tls\") pod \"model-chainer-raw-hpa-2aad0-9f8567df9-dnszn\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.268905 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.268862 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-proxy-tls\") pod \"model-chainer-raw-hpa-2aad0-9f8567df9-dnszn\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.269135 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.268924 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-2aad0-9f8567df9-dnszn\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.269511 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.269490 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-2aad0-9f8567df9-dnszn\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.271573 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.271554 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-proxy-tls\") pod \"model-chainer-raw-hpa-2aad0-9f8567df9-dnszn\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.410420 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.410378 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.682691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.682626 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn"] Sep 09 20:26:36.685174 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:26:36.685141 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3abd4b0_62e7_4aa9_a616_a8a71eb634fb.slice/crio-cb6f7ed68680bb80ea68294894797ff08bd7fcf30dfa4e61871c7680589d3394 WatchSource:0}: Error finding container cb6f7ed68680bb80ea68294894797ff08bd7fcf30dfa4e61871c7680589d3394: Status 404 returned error can't find the container with id cb6f7ed68680bb80ea68294894797ff08bd7fcf30dfa4e61871c7680589d3394 Sep 09 20:26:36.952155 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.952043 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" event={"ID":"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb","Type":"ContainerStarted","Data":"e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e"} Sep 09 20:26:36.952155 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.952110 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" event={"ID":"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb","Type":"ContainerStarted","Data":"cb6f7ed68680bb80ea68294894797ff08bd7fcf30dfa4e61871c7680589d3394"} Sep 09 20:26:36.952353 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.952162 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:36.967813 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:36.967742 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podStartSLOduration=0.96772302 podStartE2EDuration="967.72302ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:26:36.966771031 +0000 UTC m=+928.499088997" watchObservedRunningTime="2026-09-09 20:26:36.96772302 +0000 UTC m=+928.500040984" Sep 09 20:26:42.962740 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:42.962707 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:26:46.146093 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:46.146062 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn"] Sep 09 20:26:46.146482 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:46.146256 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" containerID="cri-o://e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e" gracePeriod=30 Sep 09 20:26:47.961195 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:47.961149 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:26:52.961726 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:52.961678 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:26:57.960670 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:57.960628 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:26:57.961256 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:26:57.960744 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:27:02.961454 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:02.961410 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:27:07.961359 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:07.961325 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:27:12.960661 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:12.960612 2541 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:27:16.298717 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.298686 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:27:16.319898 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.319865 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-proxy-tls\") pod \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " Sep 09 20:27:16.320083 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.319992 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-openshift-service-ca-bundle\") pod \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\" (UID: \"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb\") " Sep 09 20:27:16.320373 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.320334 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" (UID: "b3abd4b0-62e7-4aa9-a616-a8a71eb634fb"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:27:16.322652 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.322621 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" (UID: "b3abd4b0-62e7-4aa9-a616-a8a71eb634fb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:27:16.421637 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.421516 2541 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-openshift-service-ca-bundle\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:27:16.421637 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:16.421565 2541 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb-proxy-tls\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:27:17.116319 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.116280 2541 generic.go:356] "Generic (PLEG): container finished" podID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerID="e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e" exitCode=0 Sep 09 20:27:17.116523 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.116335 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" Sep 09 20:27:17.116523 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.116354 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" event={"ID":"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb","Type":"ContainerDied","Data":"e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e"} Sep 09 20:27:17.116523 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.116410 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn" event={"ID":"b3abd4b0-62e7-4aa9-a616-a8a71eb634fb","Type":"ContainerDied","Data":"cb6f7ed68680bb80ea68294894797ff08bd7fcf30dfa4e61871c7680589d3394"} Sep 09 20:27:17.116523 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.116449 2541 scope.go:117] "RemoveContainer" containerID="e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e" Sep 09 20:27:17.125893 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.125868 2541 scope.go:117] "RemoveContainer" containerID="e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e" Sep 09 20:27:17.126230 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:27:17.126201 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e\": container with ID starting with e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e not found: ID does not exist" containerID="e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e" Sep 09 20:27:17.126309 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.126242 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e"} err="failed to get container status \"e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e\": rpc error: code = NotFound desc = could not find container \"e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e\": container with ID starting with e9419efea32faa533bc9f28256ee643312c4292e3e050af34247e786edb1579e not found: ID does not exist" Sep 09 20:27:17.134351 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.134318 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn"] Sep 09 20:27:17.137490 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:17.137466 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-2aad0-9f8567df9-dnszn"] Sep 09 20:27:18.944289 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:27:18.944256 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" path="/var/lib/kubelet/pods/b3abd4b0-62e7-4aa9-a616-a8a71eb634fb/volumes" Sep 09 20:38:12.640884 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.640804 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flwrv/must-gather-8nv5d"] Sep 09 20:38:12.641328 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.641168 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" Sep 09 20:38:12.641328 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.641181 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" Sep 09 20:38:12.641328 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.641236 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3abd4b0-62e7-4aa9-a616-a8a71eb634fb" containerName="model-chainer-raw-hpa-2aad0" Sep 09 20:38:12.644357 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.644337 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.647235 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.647212 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flwrv\"/\"kube-root-ca.crt\"" Sep 09 20:38:12.647370 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.647242 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flwrv\"/\"openshift-service-ca.crt\"" Sep 09 20:38:12.647370 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.647219 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flwrv\"/\"default-dockercfg-btn4d\"" Sep 09 20:38:12.655422 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.655399 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flwrv/must-gather-8nv5d"] Sep 09 20:38:12.708933 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.708899 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8vk8\" (UniqueName: \"kubernetes.io/projected/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-kube-api-access-w8vk8\") pod \"must-gather-8nv5d\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.709104 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.708978 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-must-gather-output\") pod \"must-gather-8nv5d\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.809654 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.809619 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8vk8\" (UniqueName: \"kubernetes.io/projected/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-kube-api-access-w8vk8\") pod \"must-gather-8nv5d\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.809848 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.809719 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-must-gather-output\") pod \"must-gather-8nv5d\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.810117 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.810099 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-must-gather-output\") pod \"must-gather-8nv5d\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.818381 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.818362 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8vk8\" (UniqueName: \"kubernetes.io/projected/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-kube-api-access-w8vk8\") pod \"must-gather-8nv5d\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:12.953079 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:12.952999 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:13.227881 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:13.227852 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flwrv/must-gather-8nv5d"] Sep 09 20:38:13.230663 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:38:13.230636 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb58a7b0_4c8c_4214_823c_03dbf5eba4df.slice/crio-64118420961c07d48a5cb4de775c03145d8c08764063f866acbdfb9a94a399f7 WatchSource:0}: Error finding container 64118420961c07d48a5cb4de775c03145d8c08764063f866acbdfb9a94a399f7: Status 404 returned error can't find the container with id 64118420961c07d48a5cb4de775c03145d8c08764063f866acbdfb9a94a399f7 Sep 09 20:38:13.232960 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:13.232944 2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:38:13.714055 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:13.714018 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flwrv/must-gather-8nv5d" event={"ID":"fb58a7b0-4c8c-4214-823c-03dbf5eba4df","Type":"ContainerStarted","Data":"64118420961c07d48a5cb4de775c03145d8c08764063f866acbdfb9a94a399f7"} Sep 09 20:38:19.744628 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:19.744588 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flwrv/must-gather-8nv5d" event={"ID":"fb58a7b0-4c8c-4214-823c-03dbf5eba4df","Type":"ContainerStarted","Data":"2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e"} Sep 09 20:38:19.745090 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:19.744646 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flwrv/must-gather-8nv5d" event={"ID":"fb58a7b0-4c8c-4214-823c-03dbf5eba4df","Type":"ContainerStarted","Data":"27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250"} Sep 09 20:38:19.761531 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:19.761472 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flwrv/must-gather-8nv5d" podStartSLOduration=1.654855688 podStartE2EDuration="7.761452008s" totalImagesPullingTime="6.10659632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:38:19.76004275 +0000 UTC m=+1631.292360717" watchObservedRunningTime="2026-09-09 20:38:19.761452008 +0000 UTC m=+1631.293769974" Sep 09 20:38:42.845858 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:42.845755 2541 generic.go:356] "Generic (PLEG): container finished" podID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerID="27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250" exitCode=0 Sep 09 20:38:42.845858 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:42.845831 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flwrv/must-gather-8nv5d" event={"ID":"fb58a7b0-4c8c-4214-823c-03dbf5eba4df","Type":"ContainerDied","Data":"27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250"} Sep 09 20:38:42.846291 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:42.846139 2541 scope.go:117] "RemoveContainer" containerID="27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250" Sep 09 20:38:43.454997 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:43.454963 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-flwrv_must-gather-8nv5d_fb58a7b0-4c8c-4214-823c-03dbf5eba4df/gather/0.log" Sep 09 20:38:46.831038 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:46.831007 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gtgl_05f8baf8-a386-4aca-b3df-d9cf4e3cec64/global-pull-secret-syncer/0.log" Sep 09 20:38:46.956757 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:46.956730 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9558_63eff843-25c9-416e-b5b0-91c9140dd5b7/konnectivity-agent/0.log" Sep 09 20:38:47.022519 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:47.022491 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-188.ec2.internal_4015b4d9b6d109683c3ebeeaae56b434/haproxy/0.log" Sep 09 20:38:48.847695 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:48.847654 2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-flwrv/must-gather-8nv5d"] Sep 09 20:38:48.848176 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:48.847890 2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-flwrv/must-gather-8nv5d" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="copy" containerID="cri-o://2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e" gracePeriod=2 Sep 09 20:38:48.852574 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:48.852541 2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-flwrv/must-gather-8nv5d"] Sep 09 20:38:48.943975 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:38:48.943936 2541 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8nv5d\" is forbidden: User \"system:node:ip-10-0-143-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-flwrv\": no relationship found between node 'ip-10-0-143-188.ec2.internal' and this object" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:49.079377 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.079358 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-flwrv_must-gather-8nv5d_fb58a7b0-4c8c-4214-823c-03dbf5eba4df/copy/0.log" Sep 09 20:38:49.080825 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.080782 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:49.251312 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.251247 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8vk8\" (UniqueName: \"kubernetes.io/projected/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-kube-api-access-w8vk8\") pod \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " Sep 09 20:38:49.251415 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.251345 2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-must-gather-output\") pod \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\" (UID: \"fb58a7b0-4c8c-4214-823c-03dbf5eba4df\") " Sep 09 20:38:49.253274 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.253253 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "fb58a7b0-4c8c-4214-823c-03dbf5eba4df" (UID: "fb58a7b0-4c8c-4214-823c-03dbf5eba4df"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:38:49.253573 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.253556 2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-kube-api-access-w8vk8" (OuterVolumeSpecName: "kube-api-access-w8vk8") pod "fb58a7b0-4c8c-4214-823c-03dbf5eba4df" (UID: "fb58a7b0-4c8c-4214-823c-03dbf5eba4df"). InnerVolumeSpecName "kube-api-access-w8vk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:38:49.352894 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.352871 2541 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-must-gather-output\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:38:49.352894 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.352893 2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8vk8\" (UniqueName: \"kubernetes.io/projected/fb58a7b0-4c8c-4214-823c-03dbf5eba4df-kube-api-access-w8vk8\") on node \"ip-10-0-143-188.ec2.internal\" DevicePath \"\"" Sep 09 20:38:49.873316 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.873286 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-flwrv_must-gather-8nv5d_fb58a7b0-4c8c-4214-823c-03dbf5eba4df/copy/0.log" Sep 09 20:38:49.873750 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.873678 2541 generic.go:356] "Generic (PLEG): container finished" podID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerID="2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e" exitCode=143 Sep 09 20:38:49.873750 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.873748 2541 scope.go:117] "RemoveContainer" containerID="2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e" Sep 09 20:38:49.873904 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.873778 2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flwrv/must-gather-8nv5d" Sep 09 20:38:49.882248 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.882209 2541 scope.go:117] "RemoveContainer" containerID="27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250" Sep 09 20:38:49.893334 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.893316 2541 scope.go:117] "RemoveContainer" containerID="2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e" Sep 09 20:38:49.893616 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:38:49.893594 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e\": container with ID starting with 2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e not found: ID does not exist" containerID="2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e" Sep 09 20:38:49.893691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.893628 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e"} err="failed to get container status \"2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e\": rpc error: code = NotFound desc = could not find container \"2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e\": container with ID starting with 2a61ca8d4de8e43d5af8966876164b373f62468af8fd7bb747dc1efdd6975c9e not found: ID does not exist" Sep 09 20:38:49.893691 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.893651 2541 scope.go:117] "RemoveContainer" containerID="27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250" Sep 09 20:38:49.893945 ip-10-0-143-188 kubenswrapper[2541]: E0909 20:38:49.893928 2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250\": container with ID starting with 27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250 not found: ID does not exist" containerID="27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250" Sep 09 20:38:49.893988 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:49.893950 2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250"} err="failed to get container status \"27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250\": rpc error: code = NotFound desc = could not find container \"27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250\": container with ID starting with 27621d974e3a2f3567a6093b45d3453b8336395f6e469c20c29928e810f53250 not found: ID does not exist" Sep 09 20:38:50.931193 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:50.931164 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/alertmanager/0.log" Sep 09 20:38:50.945331 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:50.945303 2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" path="/var/lib/kubelet/pods/fb58a7b0-4c8c-4214-823c-03dbf5eba4df/volumes" Sep 09 20:38:50.951858 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:50.951842 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/config-reloader/0.log" Sep 09 20:38:50.972349 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:50.972330 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/kube-rbac-proxy-web/0.log" Sep 09 20:38:50.992096 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:50.992077 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/kube-rbac-proxy/0.log" Sep 09 20:38:51.018238 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.018219 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/kube-rbac-proxy-metric/0.log" Sep 09 20:38:51.038394 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.038376 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/prom-label-proxy/0.log" Sep 09 20:38:51.068895 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.068875 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e7ea223-bfd8-4b98-96b8-66920e263919/init-config-reloader/0.log" Sep 09 20:38:51.248091 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.248009 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85c85fc646-jbj5b_83a071d3-643a-4c9f-94b9-b938cd7bdda6/metrics-server/0.log" Sep 09 20:38:51.312236 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.312206 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsttl_b9639017-906c-415c-afc6-992d4eecd3d5/node-exporter/0.log" Sep 09 20:38:51.333844 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.333814 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsttl_b9639017-906c-415c-afc6-992d4eecd3d5/kube-rbac-proxy/0.log" Sep 09 20:38:51.361067 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.361044 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsttl_b9639017-906c-415c-afc6-992d4eecd3d5/init-textfile/0.log" Sep 09 20:38:51.645309 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.645282 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/prometheus/0.log" Sep 09 20:38:51.663995 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.663973 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/config-reloader/0.log" Sep 09 20:38:51.685238 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.685211 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/thanos-sidecar/0.log" Sep 09 20:38:51.707465 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.707444 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/kube-rbac-proxy-web/0.log" Sep 09 20:38:51.727681 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.727663 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/kube-rbac-proxy/0.log" Sep 09 20:38:51.750182 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.750155 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/kube-rbac-proxy-thanos/0.log" Sep 09 20:38:51.773475 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.773421 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb2a5c73-d8f1-4033-8e76-5caa11e05f53/init-config-reloader/0.log" Sep 09 20:38:51.846369 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.846339 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-cl5cr_cca8c7ae-e41b-482e-b95b-8e0345f66e1d/prometheus-operator-admission-webhook/0.log" Sep 09 20:38:51.958471 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.958442 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dfbbdb46f-f6kdt_45807f1c-3bdf-4e57-9caf-4b94080b3729/thanos-query/0.log" Sep 09 20:38:51.978773 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.978746 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dfbbdb46f-f6kdt_45807f1c-3bdf-4e57-9caf-4b94080b3729/kube-rbac-proxy-web/0.log" Sep 09 20:38:51.998862 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:51.998837 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dfbbdb46f-f6kdt_45807f1c-3bdf-4e57-9caf-4b94080b3729/kube-rbac-proxy/0.log" Sep 09 20:38:52.024561 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:52.024493 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dfbbdb46f-f6kdt_45807f1c-3bdf-4e57-9caf-4b94080b3729/prom-label-proxy/0.log" Sep 09 20:38:52.046041 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:52.046018 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dfbbdb46f-f6kdt_45807f1c-3bdf-4e57-9caf-4b94080b3729/kube-rbac-proxy-rules/0.log" Sep 09 20:38:52.065771 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:52.065746 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dfbbdb46f-f6kdt_45807f1c-3bdf-4e57-9caf-4b94080b3729/kube-rbac-proxy-metrics/0.log" Sep 09 20:38:54.388038 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:54.388007 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-6nlwc_03baae22-0917-4aa4-b16b-245211440de0/download-server/0.log" Sep 09 20:38:55.802993 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.802966 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k684v_934b5026-ecec-4d53-92ae-0896a9634fc5/dns/0.log" Sep 09 20:38:55.823884 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.823855 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k684v_934b5026-ecec-4d53-92ae-0896a9634fc5/kube-rbac-proxy/0.log" Sep 09 20:38:55.852359 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852328 2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t"] Sep 09 20:38:55.852642 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852631 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="copy" Sep 09 20:38:55.852686 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852645 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="copy" Sep 09 20:38:55.852686 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852656 2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="gather" Sep 09 20:38:55.852686 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852661 2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="gather" Sep 09 20:38:55.852773 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852722 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="copy" Sep 09 20:38:55.852773 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.852731 2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb58a7b0-4c8c-4214-823c-03dbf5eba4df" containerName="gather" Sep 09 20:38:55.856325 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.856304 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:55.859007 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.858983 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6t7hr\"/\"openshift-service-ca.crt\"" Sep 09 20:38:55.859744 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.859729 2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6t7hr\"/\"kube-root-ca.crt\"" Sep 09 20:38:55.859818 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.859740 2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6t7hr\"/\"default-dockercfg-lgrms\"" Sep 09 20:38:55.865939 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.865915 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t"] Sep 09 20:38:55.955198 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:55.955162 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dnkr_d0a6fa4b-86f9-48a7-a9de-f3243f01da37/dns-node-resolver/0.log" Sep 09 20:38:56.009966 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.009935 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-podres\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.010116 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.009975 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbzsr\" (UniqueName: \"kubernetes.io/projected/f554c711-3f6d-42a9-85ff-088283195029-kube-api-access-kbzsr\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.010116 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.010070 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-proc\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.010116 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.010103 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-sys\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.010232 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.010128 2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-lib-modules\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.110747 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110723 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-proc\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.110747 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110758 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-sys\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.110981 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110783 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-lib-modules\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.110981 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110874 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-proc\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.110981 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110901 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-sys\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.110981 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110928 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-lib-modules\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.111155 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.110988 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-podres\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.111155 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.111035 2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbzsr\" (UniqueName: \"kubernetes.io/projected/f554c711-3f6d-42a9-85ff-088283195029-kube-api-access-kbzsr\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.111155 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.111081 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f554c711-3f6d-42a9-85ff-088283195029-podres\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.119175 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.119134 2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbzsr\" (UniqueName: \"kubernetes.io/projected/f554c711-3f6d-42a9-85ff-088283195029-kube-api-access-kbzsr\") pod \"perf-node-gather-daemonset-kd89t\" (UID: \"f554c711-3f6d-42a9-85ff-088283195029\") " pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.166036 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.165996 2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.436215 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.436117 2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t"] Sep 09 20:38:56.439117 ip-10-0-143-188 kubenswrapper[2541]: W0909 20:38:56.439088 2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf554c711_3f6d_42a9_85ff_088283195029.slice/crio-f1e0453ecaba29c3674cf7b3ada2914da1eb43a76d313288da67abf4142fca9a WatchSource:0}: Error finding container f1e0453ecaba29c3674cf7b3ada2914da1eb43a76d313288da67abf4142fca9a: Status 404 returned error can't find the container with id f1e0453ecaba29c3674cf7b3ada2914da1eb43a76d313288da67abf4142fca9a Sep 09 20:38:56.471367 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.471343 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c57969f4c-bc8c5_2391b738-d832-459c-a26b-8aea368c6a81/registry/0.log" Sep 09 20:38:56.514765 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.514743 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-md7hk_f1c4b62d-3bae-47de-9a3f-0563d369a76a/node-ca/0.log" Sep 09 20:38:56.900528 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.900490 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" event={"ID":"f554c711-3f6d-42a9-85ff-088283195029","Type":"ContainerStarted","Data":"1f9f4f38a264d7f5a4d4f3a47abf603f3bb3551115913f150447364bdc2ed555"} Sep 09 20:38:56.900941 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.900552 2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" event={"ID":"f554c711-3f6d-42a9-85ff-088283195029","Type":"ContainerStarted","Data":"f1e0453ecaba29c3674cf7b3ada2914da1eb43a76d313288da67abf4142fca9a"} Sep 09 20:38:56.900941 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.900581 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:38:56.916352 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:56.916304 2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" podStartSLOduration=1.9162868199999998 podStartE2EDuration="1.91628682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:38:56.915019757 +0000 UTC m=+1668.447337721" watchObservedRunningTime="2026-09-09 20:38:56.91628682 +0000 UTC m=+1668.448604784" Sep 09 20:38:57.602988 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:57.602960 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8s8mr_85648db9-f2d7-432a-aac7-7302ca7bc2d6/serve-healthcheck-canary/0.log" Sep 09 20:38:57.994498 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:57.994415 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66t2s_1c2f941c-7dcc-459d-ba5a-6243cd0715ab/kube-rbac-proxy/0.log" Sep 09 20:38:58.013464 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:58.013442 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66t2s_1c2f941c-7dcc-459d-ba5a-6243cd0715ab/exporter/0.log" Sep 09 20:38:58.031967 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:38:58.031946 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66t2s_1c2f941c-7dcc-459d-ba5a-6243cd0715ab/extractor/0.log" Sep 09 20:39:02.914379 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:02.914351 2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6t7hr/perf-node-gather-daemonset-kd89t" Sep 09 20:39:04.497205 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:04.497173 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-mx5sj_cee851fb-a424-4065-b47a-456cdb42af87/migrator/0.log" Sep 09 20:39:04.514655 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:04.514624 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-mx5sj_cee851fb-a424-4065-b47a-456cdb42af87/graceful-termination/0.log" Sep 09 20:39:06.166217 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.166192 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/kube-multus-additional-cni-plugins/0.log" Sep 09 20:39:06.184929 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.184907 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/egress-router-binary-copy/0.log" Sep 09 20:39:06.203602 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.203584 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/cni-plugins/0.log" Sep 09 20:39:06.221773 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.221753 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/bond-cni-plugin/0.log" Sep 09 20:39:06.239663 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.239647 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/routeoverride-cni/0.log" Sep 09 20:39:06.257775 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.257759 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/whereabouts-cni-bincopy/0.log" Sep 09 20:39:06.278011 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.277991 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9xlx_6912f6b4-9bd7-4511-8375-58364bea40ce/whereabouts-cni/0.log" Sep 09 20:39:06.360742 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.360717 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q4wf6_97fd9c63-cb06-4501-bed6-1b9737f3134a/kube-multus/0.log" Sep 09 20:39:06.380523 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.380508 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-62rbr_f1d884e3-d206-45e3-b68a-6b625b8b1f28/network-metrics-daemon/0.log" Sep 09 20:39:06.397730 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:06.397713 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-62rbr_f1d884e3-d206-45e3-b68a-6b625b8b1f28/kube-rbac-proxy/0.log" Sep 09 20:39:07.285952 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.285927 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/ovn-controller/0.log" Sep 09 20:39:07.305745 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.305713 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/ovn-acl-logging/0.log" Sep 09 20:39:07.329379 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.329307 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/kube-rbac-proxy-node/0.log" Sep 09 20:39:07.349508 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.349488 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 20:39:07.370038 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.370016 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/northd/0.log" Sep 09 20:39:07.390889 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.390870 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/nbdb/0.log" Sep 09 20:39:07.411771 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.411748 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/sbdb/0.log" Sep 09 20:39:07.443562 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:07.443537 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2c279_b8dda626-2349-4629-bbf2-485ca55a1102/ovnkube-controller/0.log" Sep 09 20:39:08.822750 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:08.822722 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-89nn6_9a16a0f3-9d54-4b2e-b4b0-c4f5a4084da7/network-check-target-container/0.log" Sep 09 20:39:09.711404 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:09.711377 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7nzcm_f0b74ec4-5eda-4698-bd05-9f6d5d91c9f3/iptables-alerter/0.log" Sep 09 20:39:10.374324 ip-10-0-143-188 kubenswrapper[2541]: I0909 20:39:10.374295 2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xrbjv_bbd6ab51-08b8-4c07-9800-6c70d304c714/tuned/0.log"