Sep 18 14:48:59.641584 ip-10-0-131-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 14:48:59.641595 ip-10-0-131-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 14:48:59.641602 ip-10-0-131-100 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 14:48:59.641751 ip-10-0-131-100 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 14:49:10.851236 ip-10-0-131-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 14:49:10.851249 ip-10-0-131-100 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 241169533ae8450580fcbcbe5a763bed -- Sep 18 14:51:13.080788 ip-10-0-131-100 systemd[1]: Starting Kubernetes Kubelet... Sep 18 14:51:16.426993 ip-10-0-131-100 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:51:16.426993 ip-10-0-131-100 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 14:51:16.426993 ip-10-0-131-100 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:51:16.426993 ip-10-0-131-100 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 14:51:16.426993 ip-10-0-131-100 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:51:16.427871 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.427070 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431639 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431658 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431662 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431666 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431669 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431672 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:51:16.431666 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431677 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431680 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431683 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431686 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431689 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431692 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431695 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431698 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431700 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431703 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431706 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431708 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431711 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431714 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431717 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431719 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431722 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431724 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431731 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431734 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:51:16.431941 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431737 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431739 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431742 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431744 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431747 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431750 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431752 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431755 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431757 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431760 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431762 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431765 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431768 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431770 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431774 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431777 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431779 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431782 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431784 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431787 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:51:16.432435 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431790 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431792 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431795 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431797 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431800 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431803 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431805 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431807 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431810 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431812 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431815 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431818 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431820 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431823 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431826 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431828 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431831 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431833 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431836 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431839 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:51:16.432950 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431842 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431845 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431847 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431850 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431853 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431857 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431862 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431865 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431867 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431870 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431873 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431876 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431878 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431882 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431886 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431889 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431892 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431895 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431901 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:51:16.433431 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431911 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431914 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431917 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431920 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431923 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431927 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431929 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431932 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431935 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431937 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431940 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431942 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431945 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.431948 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432631 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432638 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432641 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432644 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432647 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432650 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:51:16.433947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432653 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432656 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432658 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432661 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432663 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432666 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432669 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432671 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432674 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432676 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432679 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432682 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432684 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432687 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432689 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432692 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432694 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432697 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432700 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432703 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:51:16.434438 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432705 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432708 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432711 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432713 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432716 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432718 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432720 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432723 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432725 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432728 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432730 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432734 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432737 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432739 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432744 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432748 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432752 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432754 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432757 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432761 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:51:16.434951 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432763 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432766 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432769 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432772 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432778 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432781 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432784 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432787 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432789 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432792 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432795 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432797 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432800 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432802 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432805 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432807 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432810 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432812 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432815 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:51:16.435450 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432817 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432820 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432823 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432826 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432830 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432832 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432835 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432838 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432840 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432843 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432846 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432848 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432851 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432853 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432856 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432858 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432861 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432863 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432866 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432869 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:51:16.435973 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432871 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432874 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432877 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432879 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432882 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432885 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432887 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432890 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432893 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432896 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432899 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432902 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432904 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.432907 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433266 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433271 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433277 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433280 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433282 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:51:16.436496 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433285 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433288 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433290 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433293 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433296 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433298 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433301 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433304 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433307 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433309 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433312 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433315 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433318 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433320 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433323 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433325 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433328 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433331 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433334 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433336 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:51:16.436976 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433339 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433341 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433344 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433346 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433349 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433352 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433355 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433357 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433360 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433364 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433367 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433370 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433372 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433376 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433380 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433383 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433386 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433389 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433392 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433395 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:51:16.437457 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433397 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433401 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433405 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433409 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433412 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433415 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433418 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433421 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433424 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433427 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433430 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433433 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433436 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433438 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433441 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433444 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433446 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433449 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433451 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:51:16.437952 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433454 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433457 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433460 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433463 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433466 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433468 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433471 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433473 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433476 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433478 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433481 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433484 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433503 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433506 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433508 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433511 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433513 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433516 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433520 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433522 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:51:16.438423 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433525 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433528 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433530 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433533 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433537 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433540 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433542 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433544 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433547 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433549 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433552 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433554 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433557 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433560 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.433563 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433634 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433670 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433675 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433680 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433685 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433688 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 14:51:16.439001 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433692 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433696 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433699 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433702 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433706 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433709 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433712 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433715 2581 flags.go:64] FLAG: --cgroup-root="" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433718 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433721 2581 flags.go:64] FLAG: --client-ca-file="" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433724 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433728 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433732 2581 flags.go:64] FLAG: --cluster-domain="" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433735 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433738 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433741 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433745 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433754 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433757 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433760 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433763 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433766 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433769 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433772 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 14:51:16.439539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433775 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433778 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433782 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433786 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433789 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433792 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433795 2581 flags.go:64] FLAG: --enable-server="true" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433797 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433801 2581 flags.go:64] FLAG: --event-burst="100" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433804 2581 flags.go:64] FLAG: --event-qps="50" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433807 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433810 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433813 2581 flags.go:64] FLAG: --eviction-hard="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433816 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433819 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433822 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433825 2581 flags.go:64] FLAG: --eviction-soft="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433828 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433830 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433834 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433837 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433840 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433843 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433845 2581 flags.go:64] FLAG: --feature-gates="" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433849 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 14:51:16.440134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433853 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433857 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433860 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433863 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433866 2581 flags.go:64] FLAG: --help="false" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433869 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433872 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433875 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433878 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433881 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433884 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433887 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433890 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433893 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433896 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433898 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433901 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433904 2581 flags.go:64] FLAG: --kube-reserved="" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433907 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433910 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433912 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433915 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433918 2581 flags.go:64] FLAG: --lock-file="" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433921 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 14:51:16.440760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433923 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433926 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433931 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433935 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433938 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433941 2581 flags.go:64] FLAG: --logging-format="text" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433943 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433947 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433951 2581 flags.go:64] FLAG: --manifest-url="" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433954 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433958 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433961 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433965 2581 flags.go:64] FLAG: --max-pods="110" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433968 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433971 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433974 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433978 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433981 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433984 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433987 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433995 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.433997 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434001 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 14:51:16.441365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434003 2581 flags.go:64] FLAG: --pod-cidr="" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434007 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434011 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434014 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434017 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434020 2581 flags.go:64] FLAG: --port="10250" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434023 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434026 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061bb858c7a1780a0" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434029 2581 flags.go:64] FLAG: --qos-reserved="" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434032 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434035 2581 flags.go:64] FLAG: --register-node="true" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434038 2581 flags.go:64] FLAG: --register-with-taints="" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434051 2581 flags.go:64] FLAG: --registry-burst="10" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434054 2581 flags.go:64] FLAG: --registry-qps="5" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434057 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434060 2581 flags.go:64] FLAG: --reserved-memory="" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434064 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434068 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434071 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434074 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434076 2581 flags.go:64] FLAG: --runonce="false" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434079 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434083 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434085 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434088 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 14:51:16.441944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434091 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434095 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434098 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434101 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434104 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434107 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434109 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434112 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434115 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434118 2581 flags.go:64] FLAG: --system-cgroups="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434121 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434127 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434130 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434132 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434136 2581 flags.go:64] FLAG: --tls-min-version="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434139 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434141 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434144 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434147 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434150 2581 flags.go:64] FLAG: --v="2" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434153 2581 flags.go:64] FLAG: --version="false" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434159 2581 flags.go:64] FLAG: --vmodule="" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434162 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.434166 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 14:51:16.442592 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434274 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434279 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434282 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434285 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434288 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434291 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434293 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434295 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434298 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434302 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434305 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434307 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434310 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434312 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434315 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434318 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434322 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434325 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434328 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434331 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:51:16.443181 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434334 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434337 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434340 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434343 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434346 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434349 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434351 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434354 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434356 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434359 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434362 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434365 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434369 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434371 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434374 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434376 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434379 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434382 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434384 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434387 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:51:16.443691 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434390 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434393 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434396 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434399 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434401 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434404 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434407 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434410 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434413 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434415 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434418 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434420 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434423 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434426 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434428 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434431 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434434 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434436 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434439 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434442 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:51:16.444198 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434444 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434447 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434450 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434454 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434458 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434460 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434463 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434466 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434468 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434472 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434475 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434478 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434481 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434499 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434504 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434506 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434509 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434512 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434514 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434517 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:51:16.444702 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434520 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434522 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434525 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434528 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434530 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434533 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434535 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434538 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434541 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434543 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434546 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434548 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434551 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434555 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434557 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434560 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434564 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434567 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:51:16.445197 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.434570 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.435196 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442116 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442132 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442150 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442156 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442210 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442215 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442218 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442222 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442225 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442228 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442232 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442235 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:51:16.445682 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442239 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442242 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442245 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442249 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442253 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442256 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442259 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442262 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442265 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442267 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442270 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442273 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442275 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442278 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442281 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442283 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442286 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442288 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442291 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442294 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:51:16.446037 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442297 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442301 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442304 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442307 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442309 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442312 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442314 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442317 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442320 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442322 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442325 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442327 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442330 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442332 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442335 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442337 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442340 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442342 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442345 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442348 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:51:16.446551 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442350 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442353 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442355 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442358 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442360 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442363 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442366 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442368 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442371 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442373 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442376 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442378 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442381 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442384 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442388 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442392 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442395 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442398 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442401 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:51:16.447040 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442403 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442406 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442409 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442412 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442414 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442417 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442420 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442422 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442425 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442427 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442430 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442433 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442436 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442438 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442441 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442443 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442446 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442448 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442451 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442453 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:51:16.447511 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442456 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442458 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442461 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442464 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442466 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442469 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442472 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442475 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442478 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442481 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442483 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442499 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442504 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442613 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442618 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:51:16.447999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442621 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442624 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442627 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442630 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442633 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442636 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442639 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442642 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442644 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442647 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442650 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442652 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442655 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442657 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442660 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442662 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442665 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442667 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442670 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442673 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:51:16.448387 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442675 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442678 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442681 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442683 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442686 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442689 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442692 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442696 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442699 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442702 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442705 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442708 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442711 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442714 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442716 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442719 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442721 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442724 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442727 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442729 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:51:16.448969 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442732 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442734 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442737 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442739 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442742 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442745 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442747 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442750 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442752 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442755 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442758 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442760 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442763 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442765 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442768 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442771 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442774 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442776 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442779 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442782 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:51:16.449467 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442784 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442787 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442789 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442792 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442794 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442797 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442799 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442802 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442804 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442807 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442809 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442812 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442815 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442818 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442821 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442825 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442828 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442830 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442833 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442835 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:51:16.450276 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442838 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442840 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442843 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442845 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442848 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442851 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442853 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442859 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442861 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442865 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442868 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442871 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442875 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442877 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442880 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442883 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:51:16.451478 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:16.442886 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442891 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.442990 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.444984 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.445886 2581 server.go:1019] "Starting client certificate rotation" Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.445982 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.446015 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.448316 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 14:51:16.452072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.449375 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 14:51:16.463321 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.463301 2581 log.go:25] "Validated CRI v1 runtime API" Sep 18 14:51:16.465271 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.465256 2581 log.go:25] "Validated CRI v1 image API" Sep 18 14:51:16.466032 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.466016 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 14:51:16.472438 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.472421 2581 fs.go:135] Filesystem UUIDs: map[6b0dd9c4-613e-4ee7-b82d-fc2a20606244:/dev/nvme0n1p3 78fb0030-ff80-4781-a2f2-92f210204577:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 18 14:51:16.472553 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.472438 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 14:51:16.477634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.477520 2581 manager.go:216] Machine: {Timestamp:2026-09-18 14:51:16.476177751 +0000 UTC m=+1.925887512 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086655 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec292d8921e678f6b916dde2fc10c4ce SystemUUID:ec292d89-21e6-78f6-b916-dde2fc10c4ce BootID:24116953-3ae8-4505-80fc-bcbe5a763bed Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ed:d7:65:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ed:d7:65:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:e9:a3:51:46:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 14:51:16.477634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.477627 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 14:51:16.477754 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.477703 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 14:51:16.479169 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.479142 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 14:51:16.479289 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.479171 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 14:51:16.481172 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.481161 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 14:51:16.481204 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.481175 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 14:51:16.481204 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.481183 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 14:51:16.481204 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.481194 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 14:51:16.481288 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.481259 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 14:51:16.484272 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484259 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 14:51:16.484386 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484377 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 14:51:16.484436 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484426 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 18 14:51:16.484475 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484452 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 14:51:16.484532 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484475 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 14:51:16.484532 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484502 2581 kubelet.go:398] "Adding apiserver pod source" Sep 18 14:51:16.484532 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.484530 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 14:51:16.488244 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.488226 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 14:51:16.488244 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.488246 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 14:51:16.489307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.489288 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 14:51:16.490298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.490284 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 14:51:16.492377 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.492362 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 14:51:16.492450 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.492392 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 14:51:16.493579 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493564 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493584 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493590 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493595 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493603 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493609 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493622 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493626 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493634 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 14:51:16.493639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493638 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 14:51:16.493867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493647 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 14:51:16.493867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493652 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 14:51:16.493867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493674 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 14:51:16.493867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.493679 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 14:51:16.494232 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.494207 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 14:51:16.494287 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.494249 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 14:51:16.497335 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.497321 2581 server.go:1268] "Started kubelet" Sep 18 14:51:16.497697 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.497669 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 14:51:16.497754 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.497696 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 14:51:16.498049 ip-10-0-131-100 systemd[1]: Started Kubernetes Kubelet. Sep 18 14:51:16.498426 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.498210 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 14:51:16.499079 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.499068 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 18 14:51:16.499471 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.499454 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 14:51:16.525103 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.525072 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r47zn" Sep 18 14:51:16.526607 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.526587 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r47zn" Sep 18 14:51:16.528456 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.528431 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 14:51:16.529652 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.529632 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 14:51:16.531662 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.530793 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-100.ec2.internal.18d671d879d3efd3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-100.ec2.internal,UID:ip-10-0-131-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-100.ec2.internal,},FirstTimestamp:2026-09-18 14:51:16.497158099 +0000 UTC m=+1.946867860,LastTimestamp:2026-09-18 14:51:16.497158099 +0000 UTC m=+1.946867860,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-100.ec2.internal,}" Sep 18 14:51:16.534299 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.534283 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 14:51:16.534376 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.534299 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 14:51:16.534376 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.534364 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:16.534949 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.534928 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 14:51:16.535038 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.534951 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 14:51:16.535266 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535252 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 14:51:16.535340 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535292 2581 factory.go:153] Registering CRI-O factory Sep 18 14:51:16.535340 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535305 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 18 14:51:16.535340 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535323 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 18 14:51:16.535340 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535307 2581 factory.go:223] Registration of the crio container factory successfully Sep 18 14:51:16.535517 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535382 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 14:51:16.535517 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535392 2581 factory.go:55] Registering systemd factory Sep 18 14:51:16.535517 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535399 2581 factory.go:223] Registration of the systemd container factory successfully Sep 18 14:51:16.535517 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535415 2581 factory.go:103] Registering Raw factory Sep 18 14:51:16.535517 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535428 2581 manager.go:1196] Started watching for new ooms in manager Sep 18 14:51:16.535842 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.535830 2581 manager.go:349] Starting recovery of all containers Sep 18 14:51:16.537649 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.537632 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:51:16.540462 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.540438 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-100.ec2.internal\" not found" node="ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.544699 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.544679 2581 manager.go:354] Recovery completed Sep 18 14:51:16.549048 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.549035 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.550934 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.550920 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.550997 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.550947 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.550997 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.550959 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.551444 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.551430 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 14:51:16.551444 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.551442 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 14:51:16.551564 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.551456 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 14:51:16.551564 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.551432 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.552148 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.552135 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.552196 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.552161 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.552196 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.552171 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.552939 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.552928 2581 policy_none.go:49] "None policy: Start" Sep 18 14:51:16.552975 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.552943 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 14:51:16.552975 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.552953 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 14:51:16.553845 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.553834 2581 policy_none.go:47] "Start" Sep 18 14:51:16.584036 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584020 2581 manager.go:337] "Starting Device Plugin manager" Sep 18 14:51:16.584147 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.584053 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 14:51:16.584147 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584064 2581 server.go:87] "Starting device plugin registration server" Sep 18 14:51:16.584328 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584307 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 14:51:16.584410 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584337 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 14:51:16.584631 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584562 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 14:51:16.597357 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584633 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 14:51:16.597357 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.584643 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 14:51:16.597357 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.584954 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 14:51:16.597357 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.585002 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:16.654543 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.654514 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 14:51:16.655604 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.655586 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 14:51:16.655659 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.655642 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 14:51:16.655700 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.655666 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 14:51:16.655740 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.655710 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 14:51:16.685255 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.685208 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.686008 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.685993 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.686094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.686023 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.686094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.686038 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.686094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.686066 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.686735 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.686721 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:51:16.702141 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.702122 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.702225 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.702142 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-100.ec2.internal\": node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:16.755412 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.755392 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:16.756377 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.756361 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal"] Sep 18 14:51:16.756440 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.756427 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.757211 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.757197 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.757276 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.757221 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.757276 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.757231 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.759622 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.759609 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.759746 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.759733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.759784 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.759761 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.760291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.760268 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.760291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.760276 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.760407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.760297 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.760407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.760308 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.760407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.760297 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.760407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.760374 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.761457 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.761441 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.761552 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.761466 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:51:16.762133 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.762112 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:51:16.762197 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.762138 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:51:16.762197 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.762146 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:51:16.784158 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.784138 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-100.ec2.internal\" not found" node="ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.788376 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.788359 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-100.ec2.internal\" not found" node="ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.837102 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.837084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8eb1fd79cc17874fe2d743b98ef7b8d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-100.ec2.internal\" (UID: \"c8eb1fd79cc17874fe2d743b98ef7b8d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.837185 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.837107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7aabdad31115f17279477e544a9ceb4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal\" (UID: \"7aabdad31115f17279477e544a9ceb4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.837185 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.837124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7aabdad31115f17279477e544a9ceb4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal\" (UID: \"7aabdad31115f17279477e544a9ceb4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.855817 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.855800 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:16.938273 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.938229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8eb1fd79cc17874fe2d743b98ef7b8d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-100.ec2.internal\" (UID: \"c8eb1fd79cc17874fe2d743b98ef7b8d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.938273 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.938249 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7aabdad31115f17279477e544a9ceb4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal\" (UID: \"7aabdad31115f17279477e544a9ceb4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.938273 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.938265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7aabdad31115f17279477e544a9ceb4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal\" (UID: \"7aabdad31115f17279477e544a9ceb4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.938447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.938301 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7aabdad31115f17279477e544a9ceb4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal\" (UID: \"7aabdad31115f17279477e544a9ceb4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.938447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.938332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8eb1fd79cc17874fe2d743b98ef7b8d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-100.ec2.internal\" (UID: \"c8eb1fd79cc17874fe2d743b98ef7b8d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.938447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:16.938354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7aabdad31115f17279477e544a9ceb4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal\" (UID: \"7aabdad31115f17279477e544a9ceb4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:16.956612 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:16.956593 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.057254 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.057226 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.088386 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.088371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:17.092852 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.092206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" Sep 18 14:51:17.157911 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.157740 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.258301 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.258241 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.358718 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.358689 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.446249 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.446227 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 14:51:17.446666 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.446350 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 14:51:17.446666 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.446371 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 14:51:17.459252 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.459232 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.465616 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.465595 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:51:17.531023 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.530962 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 14:46:16 +0000 UTC" deadline="2028-02-19 16:25:57.444614422 +0000 UTC" Sep 18 14:51:17.531023 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.530996 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12457h34m39.913621253s" Sep 18 14:51:17.560017 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.559994 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.609947 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:17.609921 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8eb1fd79cc17874fe2d743b98ef7b8d.slice/crio-f6d3eb0dc852bdb0cf5d7d60fcaa0c5478bdc2e469ef42cdb7f7171a42a80b3e WatchSource:0}: Error finding container f6d3eb0dc852bdb0cf5d7d60fcaa0c5478bdc2e469ef42cdb7f7171a42a80b3e: Status 404 returned error can't find the container with id f6d3eb0dc852bdb0cf5d7d60fcaa0c5478bdc2e469ef42cdb7f7171a42a80b3e Sep 18 14:51:17.610364 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:17.610345 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aabdad31115f17279477e544a9ceb4b.slice/crio-4b51da56caab540ec70fcf446c7c93bca1bb5154ecbe7b9f9b9a8b0833eab08c WatchSource:0}: Error finding container 4b51da56caab540ec70fcf446c7c93bca1bb5154ecbe7b9f9b9a8b0833eab08c: Status 404 returned error can't find the container with id 4b51da56caab540ec70fcf446c7c93bca1bb5154ecbe7b9f9b9a8b0833eab08c Sep 18 14:51:17.616416 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.616400 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 14:51:17.658882 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.658839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" event={"ID":"c8eb1fd79cc17874fe2d743b98ef7b8d","Type":"ContainerStarted","Data":"f6d3eb0dc852bdb0cf5d7d60fcaa0c5478bdc2e469ef42cdb7f7171a42a80b3e"} Sep 18 14:51:17.659950 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.659931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" event={"ID":"7aabdad31115f17279477e544a9ceb4b","Type":"ContainerStarted","Data":"4b51da56caab540ec70fcf446c7c93bca1bb5154ecbe7b9f9b9a8b0833eab08c"} Sep 18 14:51:17.661078 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.661067 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.761558 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:17.761531 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-100.ec2.internal\" not found" Sep 18 14:51:17.790456 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.790409 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:51:17.835472 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.835449 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" Sep 18 14:51:17.847994 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.847977 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 14:51:17.849124 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.849113 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" Sep 18 14:51:17.859692 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:17.859676 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 14:51:18.406551 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.406521 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:51:18.418621 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.418585 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:51:18.486236 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.486210 2581 apiserver.go:52] "Watching apiserver" Sep 18 14:51:18.492993 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.492967 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 14:51:18.493375 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.493347 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qssc6","kube-system/konnectivity-agent-bq7xl","kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb","openshift-dns/node-resolver-t5ptl","openshift-multus/multus-additional-cni-plugins-nvrxj","openshift-network-operator/iptables-alerter-9znkt","openshift-ovn-kubernetes/ovnkube-node-ngtnw","openshift-cluster-node-tuning-operator/tuned-rdwz2","openshift-image-registry/node-ca-xlpc6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal","openshift-multus/multus-slp2j","openshift-multus/network-metrics-daemon-g2bgv","openshift-network-diagnostics/network-check-target-9xcln"] Sep 18 14:51:18.494518 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.494499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.495440 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.495420 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:18.495554 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.495504 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:18.496942 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.496924 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 14:51:18.497197 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.497181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.497555 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.497536 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-srx2f\"" Sep 18 14:51:18.497786 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.497760 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:18.497881 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.497863 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.497946 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.497912 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:18.499245 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.498978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.501527 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.501142 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.502708 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.502294 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.503416 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.503169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.504123 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.503990 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 14:51:18.504123 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.504033 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v6jtv\"" Sep 18 14:51:18.504123 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.504054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.504933 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.504911 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.505040 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.505006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wr2sd\"" Sep 18 14:51:18.505040 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.505024 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.506243 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.506222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.506973 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.506957 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.507089 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.506996 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 14:51:18.507431 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.507416 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.507590 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.507468 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:18.507717 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.507697 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c966v\"" Sep 18 14:51:18.508709 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.508520 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l62v8\"" Sep 18 14:51:18.508709 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.508543 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.508709 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.508606 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.508709 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.508691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.509766 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.509748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.510252 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.510232 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.510603 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.510584 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 14:51:18.510985 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.510968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.511788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.511757 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bnk8j\"" Sep 18 14:51:18.512173 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.512157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 14:51:18.512404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.512176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.512717 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.512700 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.512839 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.512766 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.512839 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.512775 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 14:51:18.512996 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.512825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 14:51:18.513712 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.513692 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2zjrj\"" Sep 18 14:51:18.513935 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.513919 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 14:51:18.514105 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514086 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 14:51:18.514180 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514104 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 14:51:18.514180 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mj5zp\"" Sep 18 14:51:18.514290 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514274 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 14:51:18.514346 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514297 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 14:51:18.514592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 14:51:18.514875 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 14:51:18.514965 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.514892 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8z4n7\"" Sep 18 14:51:18.517614 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.517575 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 14:51:18.535115 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.535098 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 14:51:18.536157 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.536139 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 14:51:18.546559 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-multus-certs\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.546635 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a26e6f49-24e5-4498-b4b2-8760acd92b09-iptables-alerter-script\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.546635 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.546703 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljdn7\" (UniqueName: \"kubernetes.io/projected/9d14d620-e790-499c-b590-db8b3c9943e3-kube-api-access-ljdn7\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.546792 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-registration-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.546824 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-cni-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.546858 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysconfig\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.546888 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysctl-conf\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.546919 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgxb\" (UniqueName: \"kubernetes.io/projected/08016898-8e79-41f4-88e7-82982853a6e5-kube-api-access-qwgxb\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.546950 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9dea73b-2e57-4248-928a-131e3d3756f2-dbus\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.546983 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-log-socket\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.546983 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.546974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-k8s-cni-cncf-io\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.547038 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-cnibin\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.547038 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08016898-8e79-41f4-88e7-82982853a6e5-tmp\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.547094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-systemd\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.547094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovnkube-script-lib\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.547163 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-sys-fs\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.547163 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-cni-bin\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.547247 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-etc-kubernetes\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.547309 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-systemd\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.547584 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-kubelet\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.547584 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.547584 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-cni-bin\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.547584 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htvxt\" (UniqueName: \"kubernetes.io/projected/f3006540-82ff-43ae-9bc6-daf4a56af7f6-kube-api-access-htvxt\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.547820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e88c91a9-f643-451d-92b3-80b3e055d80e-agent-certs\") pod \"konnectivity-agent-bq7xl\" (UID: \"e88c91a9-f643-451d-92b3-80b3e055d80e\") " pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.547933 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.547933 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6d54\" (UniqueName: \"kubernetes.io/projected/0920eb41-05e5-4f07-af71-baae96b863ec-kube-api-access-p6d54\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.548031 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4450c953-5f51-4803-889a-6571a219c972-serviceca\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.548031 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.547990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-kubernetes\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.548031 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-sys\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.548174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-socket-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.548174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqmp\" (UniqueName: \"kubernetes.io/projected/4450c953-5f51-4803-889a-6571a219c972-kube-api-access-wxqmp\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.548174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.548174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-node-log\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.548174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-env-overrides\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.548404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-run\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.548404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:18.548404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4450c953-5f51-4803-889a-6571a219c972-host\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.548404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:18.548404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08016898-8e79-41f4-88e7-82982853a6e5-etc-tuned\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.548404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.548663 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-slash\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.548663 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-var-lib-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.548752 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.548752 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-system-cni-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.548836 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/566cccb0-d3b2-4c0b-8f89-4001d2012c30-cni-binary-copy\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.548889 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-host\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.548889 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.548983 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-cnibin\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.548983 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cnxn\" (UniqueName: \"kubernetes.io/projected/8a182eef-39b5-4828-b477-00556fb11d14-kube-api-access-6cnxn\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:18.549081 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.548975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-cni-netd\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.549081 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8z4\" (UniqueName: \"kubernetes.io/projected/a26e6f49-24e5-4498-b4b2-8760acd92b09-kube-api-access-rl8z4\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.549186 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3006540-82ff-43ae-9bc6-daf4a56af7f6-tmp-dir\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.549473 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysctl-d\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.549592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9dea73b-2e57-4248-928a-131e3d3756f2-kubelet-config\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.549592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a26e6f49-24e5-4498-b4b2-8760acd92b09-host-slash\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.549592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549570 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-system-cni-dir\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.549759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.549759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.549759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-modprobe-d\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.549759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-run-netns\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.549759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-ovn\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.549759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovn-node-metrics-cert\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.550125 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.549757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-socket-dir-parent\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550294 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-netns\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-hostroot\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e88c91a9-f643-451d-92b3-80b3e055d80e-konnectivity-ca\") pod \"konnectivity-agent-bq7xl\" (UID: \"e88c91a9-f643-451d-92b3-80b3e055d80e\") " pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.550525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-cni-multus\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-kubelet\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-conf-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-daemon-config\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j64rc\" (UniqueName: \"kubernetes.io/projected/566cccb0-d3b2-4c0b-8f89-4001d2012c30-kube-api-access-j64rc\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.550662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.550662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-lib-modules\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.550662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-systemd-units\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.550829 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovnkube-config\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.550829 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3006540-82ff-43ae-9bc6-daf4a56af7f6-hosts-file\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.550829 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-var-lib-kubelet\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.550829 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-device-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.550829 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-etc-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.550829 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.550808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqm2\" (UniqueName: \"kubernetes.io/projected/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-kube-api-access-xzqm2\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.560592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.560571 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 14:51:18.594164 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.594143 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnmtz" Sep 18 14:51:18.604056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.604037 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnmtz" Sep 18 14:51:18.651761 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-cni-netd\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.651856 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8z4\" (UniqueName: \"kubernetes.io/projected/a26e6f49-24e5-4498-b4b2-8760acd92b09-kube-api-access-rl8z4\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.651856 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3006540-82ff-43ae-9bc6-daf4a56af7f6-tmp-dir\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.651856 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-cni-netd\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.652014 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysctl-d\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.652014 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9dea73b-2e57-4248-928a-131e3d3756f2-kubelet-config\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.652014 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a26e6f49-24e5-4498-b4b2-8760acd92b09-host-slash\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.652014 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-system-cni-dir\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.652014 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.651989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3006540-82ff-43ae-9bc6-daf4a56af7f6-tmp-dir\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a26e6f49-24e5-4498-b4b2-8760acd92b09-host-slash\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9dea73b-2e57-4248-928a-131e3d3756f2-kubelet-config\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysctl-d\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-modprobe-d\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-system-cni-dir\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-run-netns\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-ovn\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovn-node-metrics-cert\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-run-netns\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-socket-dir-parent\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-modprobe-d\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-netns\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652252 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-ovn\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-hostroot\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.652291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e88c91a9-f643-451d-92b3-80b3e055d80e-konnectivity-ca\") pod \"konnectivity-agent-bq7xl\" (UID: \"e88c91a9-f643-451d-92b3-80b3e055d80e\") " pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-cni-multus\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-kubelet\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-cni-multus\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-socket-dir-parent\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-conf-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-hostroot\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-kubelet\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-netns\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-daemon-config\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652548 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j64rc\" (UniqueName: \"kubernetes.io/projected/566cccb0-d3b2-4c0b-8f89-4001d2012c30-kube-api-access-j64rc\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-lib-modules\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-systemd-units\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652663 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovnkube-config\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.653092 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3006540-82ff-43ae-9bc6-daf4a56af7f6-hosts-file\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-var-lib-kubelet\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-systemd-units\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-conf-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-var-lib-kubelet\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-device-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652940 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3006540-82ff-43ae-9bc6-daf4a56af7f6-hosts-file\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.652979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-etc-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqm2\" (UniqueName: \"kubernetes.io/projected/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-kube-api-access-xzqm2\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e88c91a9-f643-451d-92b3-80b3e055d80e-konnectivity-ca\") pod \"konnectivity-agent-bq7xl\" (UID: \"e88c91a9-f643-451d-92b3-80b3e055d80e\") " pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-multus-certs\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-lib-modules\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-etc-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-multus-certs\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-daemon-config\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a26e6f49-24e5-4498-b4b2-8760acd92b09-iptables-alerter-script\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljdn7\" (UniqueName: \"kubernetes.io/projected/9d14d620-e790-499c-b590-db8b3c9943e3-kube-api-access-ljdn7\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-registration-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-cni-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-device-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysconfig\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysconfig\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-registration-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysctl-conf\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgxb\" (UniqueName: \"kubernetes.io/projected/08016898-8e79-41f4-88e7-82982853a6e5-kube-api-access-qwgxb\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-multus-cni-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9dea73b-2e57-4248-928a-131e3d3756f2-dbus\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovnkube-config\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-log-socket\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-log-socket\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-k8s-cni-cncf-io\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-run-k8s-cni-cncf-io\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.654722 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-sysctl-conf\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9dea73b-2e57-4248-928a-131e3d3756f2-dbus\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-cnibin\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08016898-8e79-41f4-88e7-82982853a6e5-tmp\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-systemd\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d14d620-e790-499c-b590-db8b3c9943e3-cnibin\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d14d620-e790-499c-b590-db8b3c9943e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a26e6f49-24e5-4498-b4b2-8760acd92b09-iptables-alerter-script\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovnkube-script-lib\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653685 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-systemd\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-sys-fs\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-cni-bin\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-sys-fs\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-etc-kubernetes\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-systemd\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-kubelet\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-etc-kubernetes\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.655509 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-cni-bin\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-cni-bin\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653908 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-kubelet\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-systemd\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvxt\" (UniqueName: \"kubernetes.io/projected/f3006540-82ff-43ae-9bc6-daf4a56af7f6-kube-api-access-htvxt\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-host-var-lib-cni-bin\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e88c91a9-f643-451d-92b3-80b3e055d80e-agent-certs\") pod \"konnectivity-agent-bq7xl\" (UID: \"e88c91a9-f643-451d-92b3-80b3e055d80e\") " pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.653990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6d54\" (UniqueName: \"kubernetes.io/projected/0920eb41-05e5-4f07-af71-baae96b863ec-kube-api-access-p6d54\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4450c953-5f51-4803-889a-6571a219c972-serviceca\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654067 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-kubernetes\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-sys\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-socket-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654138 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovnkube-script-lib\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqmp\" (UniqueName: \"kubernetes.io/projected/4450c953-5f51-4803-889a-6571a219c972-kube-api-access-wxqmp\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-etc-kubernetes\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-sys\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-run-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-node-log\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-env-overrides\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-run\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-socket-dir\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4450c953-5f51-4803-889a-6571a219c972-host\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-run\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08016898-8e79-41f4-88e7-82982853a6e5-etc-tuned\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-node-log\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-slash\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-var-lib-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.656788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4450c953-5f51-4803-889a-6571a219c972-serviceca\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-system-cni-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/566cccb0-d3b2-4c0b-8f89-4001d2012c30-cni-binary-copy\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.654660 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-host\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4450c953-5f51-4803-889a-6571a219c972-host\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-cnibin\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cnxn\" (UniqueName: \"kubernetes.io/projected/8a182eef-39b5-4828-b477-00556fb11d14-kube-api-access-6cnxn\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-var-lib-openvswitch\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.654830 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:19.154796651 +0000 UTC m=+4.604506420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.654909 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-env-overrides\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.655027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-system-cni-dir\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.655034 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:19.155016933 +0000 UTC m=+4.604726696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.654947 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08016898-8e79-41f4-88e7-82982853a6e5-host\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.657348 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.655074 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.655113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-host-slash\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.655129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/566cccb0-d3b2-4c0b-8f89-4001d2012c30-cnibin\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.655217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0920eb41-05e5-4f07-af71-baae96b863ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.655447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/566cccb0-d3b2-4c0b-8f89-4001d2012c30-cni-binary-copy\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.656715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08016898-8e79-41f4-88e7-82982853a6e5-tmp\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.656759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-ovn-node-metrics-cert\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.656998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08016898-8e79-41f4-88e7-82982853a6e5-etc-tuned\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.657907 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.657097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e88c91a9-f643-451d-92b3-80b3e055d80e-agent-certs\") pod \"konnectivity-agent-bq7xl\" (UID: \"e88c91a9-f643-451d-92b3-80b3e055d80e\") " pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.664157 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.664126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j64rc\" (UniqueName: \"kubernetes.io/projected/566cccb0-d3b2-4c0b-8f89-4001d2012c30-kube-api-access-j64rc\") pod \"multus-slp2j\" (UID: \"566cccb0-d3b2-4c0b-8f89-4001d2012c30\") " pod="openshift-multus/multus-slp2j" Sep 18 14:51:18.664366 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.664337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqm2\" (UniqueName: \"kubernetes.io/projected/971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788-kube-api-access-xzqm2\") pod \"ovnkube-node-ngtnw\" (UID: \"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.664538 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.664518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8z4\" (UniqueName: \"kubernetes.io/projected/a26e6f49-24e5-4498-b4b2-8760acd92b09-kube-api-access-rl8z4\") pod \"iptables-alerter-9znkt\" (UID: \"a26e6f49-24e5-4498-b4b2-8760acd92b09\") " pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.666926 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.666893 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgxb\" (UniqueName: \"kubernetes.io/projected/08016898-8e79-41f4-88e7-82982853a6e5-kube-api-access-qwgxb\") pod \"tuned-rdwz2\" (UID: \"08016898-8e79-41f4-88e7-82982853a6e5\") " pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.667116 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.667097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljdn7\" (UniqueName: \"kubernetes.io/projected/9d14d620-e790-499c-b590-db8b3c9943e3-kube-api-access-ljdn7\") pod \"multus-additional-cni-plugins-nvrxj\" (UID: \"9d14d620-e790-499c-b590-db8b3c9943e3\") " pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.667355 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.667336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvxt\" (UniqueName: \"kubernetes.io/projected/f3006540-82ff-43ae-9bc6-daf4a56af7f6-kube-api-access-htvxt\") pod \"node-resolver-t5ptl\" (UID: \"f3006540-82ff-43ae-9bc6-daf4a56af7f6\") " pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.674691 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.672379 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:18.674691 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.672408 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:18.674691 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.672423 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:18.674691 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.672863 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cnxn\" (UniqueName: \"kubernetes.io/projected/8a182eef-39b5-4828-b477-00556fb11d14-kube-api-access-6cnxn\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:18.674691 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.673240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6d54\" (UniqueName: \"kubernetes.io/projected/0920eb41-05e5-4f07-af71-baae96b863ec-kube-api-access-p6d54\") pod \"aws-ebs-csi-driver-node-kjpbb\" (UID: \"0920eb41-05e5-4f07-af71-baae96b863ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.674691 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:18.673504 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:51:19.173469157 +0000 UTC m=+4.623178923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:18.676190 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.676169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqmp\" (UniqueName: \"kubernetes.io/projected/4450c953-5f51-4803-889a-6571a219c972-kube-api-access-wxqmp\") pod \"node-ca-xlpc6\" (UID: \"4450c953-5f51-4803-889a-6571a219c972\") " pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.808448 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.808415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9znkt" Sep 18 14:51:18.816023 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.816002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" Sep 18 14:51:18.823427 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.823410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5ptl" Sep 18 14:51:18.827737 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.827723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" Sep 18 14:51:18.835293 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.835275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" Sep 18 14:51:18.841805 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.841786 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:18.850129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.850110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xlpc6" Sep 18 14:51:18.856460 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.856440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:18.861887 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:18.861869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slp2j" Sep 18 14:51:19.159197 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.159163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:19.159370 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.159206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:19.159370 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.159304 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:19.159370 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.159309 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:19.159370 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.159362 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:20.159347581 +0000 UTC m=+5.609057347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:19.159616 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.159377 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:20.159369941 +0000 UTC m=+5.609079688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:19.260330 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.260299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:19.260506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.260464 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:19.260506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.260481 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:19.260506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.260507 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:19.260632 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.260560 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:51:20.260546152 +0000 UTC m=+5.710255913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:19.417843 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.417621 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26e6f49_24e5_4498_b4b2_8760acd92b09.slice/crio-e4cf2ecf4a1592a65533fd02f760c0c681db706c17f8cc46da1296827d0c957b WatchSource:0}: Error finding container e4cf2ecf4a1592a65533fd02f760c0c681db706c17f8cc46da1296827d0c957b: Status 404 returned error can't find the container with id e4cf2ecf4a1592a65533fd02f760c0c681db706c17f8cc46da1296827d0c957b Sep 18 14:51:19.419029 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.418995 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08016898_8e79_41f4_88e7_82982853a6e5.slice/crio-1120bfa60b8a82c54df3f725d586965e38c716967de8169d70a0266a9b3ab4d8 WatchSource:0}: Error finding container 1120bfa60b8a82c54df3f725d586965e38c716967de8169d70a0266a9b3ab4d8: Status 404 returned error can't find the container with id 1120bfa60b8a82c54df3f725d586965e38c716967de8169d70a0266a9b3ab4d8 Sep 18 14:51:19.420929 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.420851 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4450c953_5f51_4803_889a_6571a219c972.slice/crio-e8db939f5c1db9e32a6c60c8ee481e862a29217dbc9521d9072c739b2c74bcbe WatchSource:0}: Error finding container e8db939f5c1db9e32a6c60c8ee481e862a29217dbc9521d9072c739b2c74bcbe: Status 404 returned error can't find the container with id e8db939f5c1db9e32a6c60c8ee481e862a29217dbc9521d9072c739b2c74bcbe Sep 18 14:51:19.422412 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.422357 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566cccb0_d3b2_4c0b_8f89_4001d2012c30.slice/crio-45a53ec607e770bf783918bb4fe29b95415235aeb3e6acbc873d11256410613a WatchSource:0}: Error finding container 45a53ec607e770bf783918bb4fe29b95415235aeb3e6acbc873d11256410613a: Status 404 returned error can't find the container with id 45a53ec607e770bf783918bb4fe29b95415235aeb3e6acbc873d11256410613a Sep 18 14:51:19.424334 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.424307 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971ee4dd_e6fe_4cc8_be2e_9b69d4b0a788.slice/crio-351fd6df8fb110e0796c97b2131d0c4c095bfc2b2ad560cf0379dff351bbe7c0 WatchSource:0}: Error finding container 351fd6df8fb110e0796c97b2131d0c4c095bfc2b2ad560cf0379dff351bbe7c0: Status 404 returned error can't find the container with id 351fd6df8fb110e0796c97b2131d0c4c095bfc2b2ad560cf0379dff351bbe7c0 Sep 18 14:51:19.425271 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.425213 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88c91a9_f643_451d_92b3_80b3e055d80e.slice/crio-f5dae9778a73389ce7f8c8529f40ebb514604afbeada3aa1d77c98dc49bb97e5 WatchSource:0}: Error finding container f5dae9778a73389ce7f8c8529f40ebb514604afbeada3aa1d77c98dc49bb97e5: Status 404 returned error can't find the container with id f5dae9778a73389ce7f8c8529f40ebb514604afbeada3aa1d77c98dc49bb97e5 Sep 18 14:51:19.426088 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.425982 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0920eb41_05e5_4f07_af71_baae96b863ec.slice/crio-7d3dfc6070b9ce1c3e2b818d9d39f208013bc0e2443cb1be51a4242ac6960779 WatchSource:0}: Error finding container 7d3dfc6070b9ce1c3e2b818d9d39f208013bc0e2443cb1be51a4242ac6960779: Status 404 returned error can't find the container with id 7d3dfc6070b9ce1c3e2b818d9d39f208013bc0e2443cb1be51a4242ac6960779 Sep 18 14:51:19.427067 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:51:19.426768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3006540_82ff_43ae_9bc6_daf4a56af7f6.slice/crio-8acad6824dc65b4ed4bb44f4e864ce4f839a80ce0257037740edd3a338ddad00 WatchSource:0}: Error finding container 8acad6824dc65b4ed4bb44f4e864ce4f839a80ce0257037740edd3a338ddad00: Status 404 returned error can't find the container with id 8acad6824dc65b4ed4bb44f4e864ce4f839a80ce0257037740edd3a338ddad00 Sep 18 14:51:19.606099 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.606068 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 14:46:18 +0000 UTC" deadline="2028-04-21 01:48:09.069307078 +0000 UTC" Sep 18 14:51:19.606099 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.606095 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13930h56m49.463215799s" Sep 18 14:51:19.655942 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.655920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:19.656019 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.655952 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:19.656062 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.656027 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:19.656172 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:19.656151 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:19.664660 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.664432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5ptl" event={"ID":"f3006540-82ff-43ae-9bc6-daf4a56af7f6","Type":"ContainerStarted","Data":"8acad6824dc65b4ed4bb44f4e864ce4f839a80ce0257037740edd3a338ddad00"} Sep 18 14:51:19.665582 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.665564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xlpc6" event={"ID":"4450c953-5f51-4803-889a-6571a219c972","Type":"ContainerStarted","Data":"e8db939f5c1db9e32a6c60c8ee481e862a29217dbc9521d9072c739b2c74bcbe"} Sep 18 14:51:19.666696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.666674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9znkt" event={"ID":"a26e6f49-24e5-4498-b4b2-8760acd92b09","Type":"ContainerStarted","Data":"e4cf2ecf4a1592a65533fd02f760c0c681db706c17f8cc46da1296827d0c957b"} Sep 18 14:51:19.668637 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.668608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" event={"ID":"c8eb1fd79cc17874fe2d743b98ef7b8d","Type":"ContainerStarted","Data":"8240662ad81ac520f07d2d9a3c8dcc84dcdf33f53f7b62c0beec8fe7f9c0f703"} Sep 18 14:51:19.669699 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.669677 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" event={"ID":"0920eb41-05e5-4f07-af71-baae96b863ec","Type":"ContainerStarted","Data":"7d3dfc6070b9ce1c3e2b818d9d39f208013bc0e2443cb1be51a4242ac6960779"} Sep 18 14:51:19.670672 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.670653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bq7xl" event={"ID":"e88c91a9-f643-451d-92b3-80b3e055d80e","Type":"ContainerStarted","Data":"f5dae9778a73389ce7f8c8529f40ebb514604afbeada3aa1d77c98dc49bb97e5"} Sep 18 14:51:19.671821 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.671802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"351fd6df8fb110e0796c97b2131d0c4c095bfc2b2ad560cf0379dff351bbe7c0"} Sep 18 14:51:19.672796 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.672773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slp2j" event={"ID":"566cccb0-d3b2-4c0b-8f89-4001d2012c30","Type":"ContainerStarted","Data":"45a53ec607e770bf783918bb4fe29b95415235aeb3e6acbc873d11256410613a"} Sep 18 14:51:19.673847 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.673830 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" event={"ID":"08016898-8e79-41f4-88e7-82982853a6e5","Type":"ContainerStarted","Data":"1120bfa60b8a82c54df3f725d586965e38c716967de8169d70a0266a9b3ab4d8"} Sep 18 14:51:19.675278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.675254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" event={"ID":"7aabdad31115f17279477e544a9ceb4b","Type":"ContainerStarted","Data":"c0f989acaa6a9913d9cd3460075a6fc371639c02c5969f8eedf7841713eeec46"} Sep 18 14:51:19.676264 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.676245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerStarted","Data":"256ce4ab65d0fbc484c078227356846cf1b47af144c1af072d0c4fe14c16a1da"} Sep 18 14:51:19.683104 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:19.683067 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-100.ec2.internal" podStartSLOduration=2.6830571 podStartE2EDuration="2.6830571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:19.682913053 +0000 UTC m=+5.132622822" watchObservedRunningTime="2026-09-18 14:51:19.6830571 +0000 UTC m=+5.132766861" Sep 18 14:51:20.168685 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.167880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:20.168685 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.167946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:20.168685 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.168103 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:20.168685 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.168159 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:22.168141351 +0000 UTC m=+7.617851105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:20.168685 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.168574 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:20.168685 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.168626 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:22.168609813 +0000 UTC m=+7.618319576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:20.268868 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.268263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:20.268868 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.268448 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:20.268868 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.268467 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:20.268868 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.268478 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:20.268868 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.268549 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:51:22.26853266 +0000 UTC m=+7.718242414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:20.606747 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.606633 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 14:46:18 +0000 UTC" deadline="2028-05-30 21:50:07.154760444 +0000 UTC" Sep 18 14:51:20.606747 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.606699 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14886h58m46.548065317s" Sep 18 14:51:20.659026 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.658995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:20.659184 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:20.659118 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:20.704671 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.704632 2581 generic.go:356] "Generic (PLEG): container finished" podID="7aabdad31115f17279477e544a9ceb4b" containerID="c0f989acaa6a9913d9cd3460075a6fc371639c02c5969f8eedf7841713eeec46" exitCode=0 Sep 18 14:51:20.704846 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:20.704814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" event={"ID":"7aabdad31115f17279477e544a9ceb4b","Type":"ContainerDied","Data":"c0f989acaa6a9913d9cd3460075a6fc371639c02c5969f8eedf7841713eeec46"} Sep 18 14:51:21.656902 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:21.656201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:21.656902 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:21.656345 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:21.656902 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:21.656718 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:21.656902 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:21.656799 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:21.729759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:21.729720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" event={"ID":"7aabdad31115f17279477e544a9ceb4b","Type":"ContainerStarted","Data":"186934357c31a4e94def7adba4a3ec3f2384de17f0b963b0fbd1431178b2f6ba"} Sep 18 14:51:22.186439 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:22.186405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:22.186615 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:22.186461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:22.186690 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.186616 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:22.186690 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.186675 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:26.186657375 +0000 UTC m=+11.636367143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:22.187093 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.187072 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:22.187197 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.187127 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:26.187112757 +0000 UTC m=+11.636822518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:22.287069 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:22.287035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:22.287231 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.287214 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:22.287310 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.287242 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:22.287310 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.287254 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:22.287310 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.287306 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:51:26.287288432 +0000 UTC m=+11.736998201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:22.658877 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:22.658805 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:22.659295 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:22.658932 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:23.656317 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:23.656261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:23.656506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:23.656395 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:23.656506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:23.656472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:23.656632 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:23.656604 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:24.656091 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:24.656060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:24.656484 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:24.656199 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:25.656153 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:25.656110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:25.656153 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:25.656150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:25.656741 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:25.656255 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:25.656930 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:25.656878 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:26.221456 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:26.221119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:26.221456 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:26.221180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:26.221456 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.221295 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:26.221456 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.221306 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:26.221456 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.221360 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:34.221343076 +0000 UTC m=+19.671052837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:26.221456 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.221380 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:34.221370067 +0000 UTC m=+19.671079817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:26.321558 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:26.321523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:26.321717 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.321695 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:26.321717 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.321714 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:26.321825 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.321727 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:26.321825 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.321798 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:51:34.321769455 +0000 UTC m=+19.771479222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:26.657055 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:26.656918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:26.657055 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:26.657020 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:27.656808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:27.656729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:27.656808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:27.656755 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:27.657019 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:27.656851 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:27.657019 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:27.656969 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:28.656744 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:28.656704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:28.656913 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:28.656818 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:29.655993 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:29.655920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:29.655993 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:29.655953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:29.656448 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:29.656053 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:29.656448 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:29.656210 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:30.656943 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:30.656905 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:30.657529 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:30.657039 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:31.656101 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:31.656070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:31.656272 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:31.656189 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:31.656272 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:31.656247 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:31.656385 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:31.656363 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:32.656298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:32.656265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:32.656766 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:32.656381 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:33.656261 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:33.656230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:33.656529 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:33.656274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:33.656529 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:33.656369 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:33.656529 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:33.656513 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:34.280499 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:34.280448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:34.280680 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:34.280512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:34.280680 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.280613 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:34.280796 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.280690 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:50.280669964 +0000 UTC m=+35.730379722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:34.280796 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.280622 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:34.280796 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.280751 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:50.280736447 +0000 UTC m=+35.730446218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:34.381316 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:34.381282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:34.381506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.381414 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:34.381506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.381438 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:34.381506 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.381450 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:34.381660 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.381521 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:51:50.381501668 +0000 UTC m=+35.831211432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:34.656201 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:34.656125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:34.656355 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:34.656241 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:35.656461 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:35.656426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:35.656894 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:35.656440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:35.656894 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:35.656570 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:35.656894 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:35.656600 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:36.656991 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:36.656963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:36.657349 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:36.657038 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:37.656610 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.656384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:37.656735 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.656415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:37.656735 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:37.656669 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:37.656826 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:37.656779 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:37.764345 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.764309 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5ptl" event={"ID":"f3006540-82ff-43ae-9bc6-daf4a56af7f6","Type":"ContainerStarted","Data":"615559bf9d876401fe2081dbcea12de82460fcb71c4727dd73978e3c8ba41ab0"} Sep 18 14:51:37.766460 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.766429 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xlpc6" event={"ID":"4450c953-5f51-4803-889a-6571a219c972","Type":"ContainerStarted","Data":"7e3f5fa7921129f11fd8043210e768caada6c9b583b09064558ade69980b644d"} Sep 18 14:51:37.768196 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.768171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" event={"ID":"0920eb41-05e5-4f07-af71-baae96b863ec","Type":"ContainerStarted","Data":"6bd1f12817edfe0f2b77443ab8ff1812a82049dee514e2f291a22c61c6adcb09"} Sep 18 14:51:37.770056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.770029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bq7xl" event={"ID":"e88c91a9-f643-451d-92b3-80b3e055d80e","Type":"ContainerStarted","Data":"54322a0e405a461e5069238fbf5eb22e297523beb69463c44b7427b853c7ae35"} Sep 18 14:51:37.773106 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 14:51:37.773448 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773431 2581 generic.go:356] "Generic (PLEG): container finished" podID="971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788" containerID="91b0f0b6f4f93b6326122e636b3826b3a2ecb194a1126568bcdb8c9c0f14e630" exitCode=1 Sep 18 14:51:37.773564 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"42296702e3834e1cefa7008864399c506b93246fcedd920d48f20782886cd8e4"} Sep 18 14:51:37.773564 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"7a2e35a7185e8225e82e38676e5d8a48c5b8f32c03b3cd23398826014197bb1f"} Sep 18 14:51:37.773649 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"bc538896c8f352f0ba46c8cbdea1ad91be92a45b639eb2f96cccb2a8db4dfb41"} Sep 18 14:51:37.773649 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"257e7a66ac7c8a871cfd50ef6783826ffd4a1c691bb4ef2536cc2313239cf31f"} Sep 18 14:51:37.773725 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773660 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerDied","Data":"91b0f0b6f4f93b6326122e636b3826b3a2ecb194a1126568bcdb8c9c0f14e630"} Sep 18 14:51:37.773725 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.773696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"d6fbb7d1a8b9fa6d1b8b7f3467c9abea19d822b6309d760200c26ad7fae188a8"} Sep 18 14:51:37.775096 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.775063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slp2j" event={"ID":"566cccb0-d3b2-4c0b-8f89-4001d2012c30","Type":"ContainerStarted","Data":"7001e93059bceab2ac7530c90059fb95bd3e70193df4fd36fa30bdb83e1fdfd3"} Sep 18 14:51:37.776336 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.776314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" event={"ID":"08016898-8e79-41f4-88e7-82982853a6e5","Type":"ContainerStarted","Data":"707eae501a98e9441a0ff7532de99e259ff2e24b5e77132edc42b019cecd928f"} Sep 18 14:51:37.777731 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.777711 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d14d620-e790-499c-b590-db8b3c9943e3" containerID="0d91effad8f41993bbab4dfc7aa1fb741d710aa3624b64de445e5ecd12635d86" exitCode=0 Sep 18 14:51:37.777831 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.777736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerDied","Data":"0d91effad8f41993bbab4dfc7aa1fb741d710aa3624b64de445e5ecd12635d86"} Sep 18 14:51:37.789539 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.789505 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5ptl" podStartSLOduration=4.476292216 podStartE2EDuration="21.789476329s" totalImagesPullingTime="17.313184113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:37.789447581 +0000 UTC m=+23.239157351" watchObservedRunningTime="2026-09-18 14:51:37.789476329 +0000 UTC m=+23.239186099" Sep 18 14:51:37.789870 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.789850 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-100.ec2.internal" podStartSLOduration=20.789840939 podStartE2EDuration="20.789840939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:21.763840771 +0000 UTC m=+7.213550542" watchObservedRunningTime="2026-09-18 14:51:37.789840939 +0000 UTC m=+23.239550708" Sep 18 14:51:37.808510 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.808461 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bq7xl" podStartSLOduration=8.721421087 podStartE2EDuration="21.808449172s" totalImagesPullingTime="13.087028085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:37.808442433 +0000 UTC m=+23.258152217" watchObservedRunningTime="2026-09-18 14:51:37.808449172 +0000 UTC m=+23.258158942" Sep 18 14:51:37.847828 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.847790 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rdwz2" podStartSLOduration=4.527463141 podStartE2EDuration="21.847778488s" totalImagesPullingTime="17.320315347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:37.847299188 +0000 UTC m=+23.297008958" watchObservedRunningTime="2026-09-18 14:51:37.847778488 +0000 UTC m=+23.297488257" Sep 18 14:51:37.880880 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.880830 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xlpc6" podStartSLOduration=4.594251912 podStartE2EDuration="21.880807908s" totalImagesPullingTime="17.286555996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:37.879144761 +0000 UTC m=+23.328854522" watchObservedRunningTime="2026-09-18 14:51:37.880807908 +0000 UTC m=+23.330517680" Sep 18 14:51:37.897847 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.897814 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-slp2j" podStartSLOduration=4.5307173259999995 podStartE2EDuration="21.897802041s" totalImagesPullingTime="17.367084715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:37.897792593 +0000 UTC m=+23.347502363" watchObservedRunningTime="2026-09-18 14:51:37.897802041 +0000 UTC m=+23.347511808" Sep 18 14:51:37.980512 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:37.980280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:38.094604 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.094576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:38.196007 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.195983 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:38.213188 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.213169 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 14:51:38.594779 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.594686 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T14:51:38.213183375Z","UUID":"f7d6e34f-e903-4786-b725-475ead745877","Handler":null,"Name":"","Endpoint":""} Sep 18 14:51:38.596424 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.596405 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 14:51:38.596558 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.596439 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 14:51:38.656629 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.656593 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:38.656762 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:38.656712 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:38.783472 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.783393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" event={"ID":"0920eb41-05e5-4f07-af71-baae96b863ec","Type":"ContainerStarted","Data":"2978e7199199fb0a64768e3a4e2a842db300080d9a7939cf0425e53ffd64d113"} Sep 18 14:51:38.785412 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.785380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9znkt" event={"ID":"a26e6f49-24e5-4498-b4b2-8760acd92b09","Type":"ContainerStarted","Data":"8075872499c7bcf3898bfb0ae28d3c7583addbe0a6612fda503c8fbb4a5d0f64"} Sep 18 14:51:38.800712 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.800674 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9znkt" podStartSLOduration=5.511788478 podStartE2EDuration="22.800660007s" totalImagesPullingTime="17.288871529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:38.800253289 +0000 UTC m=+24.249963061" watchObservedRunningTime="2026-09-18 14:51:38.800660007 +0000 UTC m=+24.250369777" Sep 18 14:51:38.922523 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.922401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:38.978067 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:38.978031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.113188 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.113161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.188808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.188746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.322827 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.322791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.388864 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.388835 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.489558 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.489524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.656149 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.656118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:39.656149 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.656138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:39.656329 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:39.656232 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:39.656394 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:39.656371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:39.783243 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.783161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:39.792108 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.792081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" event={"ID":"0920eb41-05e5-4f07-af71-baae96b863ec","Type":"ContainerStarted","Data":"7ec640a6f9550ebd59b58dff4a12305de62dc6b88d858db5d7791fcb1e07b7ae"} Sep 18 14:51:39.795629 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.795604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 14:51:39.797026 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.796996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"f7a278011583d42a7d57a66052a212cab17f5104c29f47b4c398feb7e160967a"} Sep 18 14:51:39.811609 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.811563 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjpbb" podStartSLOduration=4.428769106 podStartE2EDuration="23.811550533s" totalImagesPullingTime="19.382781427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:39.810749839 +0000 UTC m=+25.260459609" watchObservedRunningTime="2026-09-18 14:51:39.811550533 +0000 UTC m=+25.261260303" Sep 18 14:51:39.866599 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:39.866579 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:40.060501 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:40.060412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:40.160649 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:40.160613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:40.656111 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:40.656082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:40.656271 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:40.656204 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:40.874564 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:40.874534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5ptl_f3006540-82ff-43ae-9bc6-daf4a56af7f6/dns-node-resolver/0.log" Sep 18 14:51:41.656284 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.656250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:41.656410 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.656379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:41.656520 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:41.656376 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:41.656588 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:41.656473 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:41.705214 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.705188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:41.759468 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.759339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:41.876066 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.875526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xlpc6_4450c953-5f51-4803-889a-6571a219c972/node-ca/0.log" Sep 18 14:51:41.998726 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.998702 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:41.999186 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:41.999167 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:42.437994 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.437970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:42.517896 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.517869 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:42.656358 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.656334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:42.656476 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:42.656435 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:42.806525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.806458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 14:51:42.806859 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.806838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"d3492184908dbad08235ddb114aa5977c5ce2cc01a10e1e60b38d24c1c48db86"} Sep 18 14:51:42.807059 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.807036 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:42.807242 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.807224 2581 scope.go:117] "RemoveContainer" containerID="91b0f0b6f4f93b6326122e636b3826b3a2ecb194a1126568bcdb8c9c0f14e630" Sep 18 14:51:42.808891 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.808868 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d14d620-e790-499c-b590-db8b3c9943e3" containerID="f34dbf91a80ac7d807d7172e01501afed7d9a9a5de74fccda774140b66dd69db" exitCode=0 Sep 18 14:51:42.808976 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.808950 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerDied","Data":"f34dbf91a80ac7d807d7172e01501afed7d9a9a5de74fccda774140b66dd69db"} Sep 18 14:51:42.822447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.822429 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:42.901665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.901645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:42.922630 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.922609 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:42.923109 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:42.923093 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bq7xl" Sep 18 14:51:43.656813 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.656784 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:43.656959 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:43.656880 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:43.656959 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.656944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:43.657073 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:43.657047 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:43.816041 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.815894 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 14:51:43.816469 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.816436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" event={"ID":"971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788","Type":"ContainerStarted","Data":"ab41b4abc3bdd931e854d76c83efb25bae3fb5e3280999a4289cb63ae47c4e1a"} Sep 18 14:51:43.816670 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.816566 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 14:51:43.816978 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.816957 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:43.832004 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.831986 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:43.849174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:43.849130 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" podStartSLOduration=10.525705358 podStartE2EDuration="27.849116821s" totalImagesPullingTime="17.323411463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:43.847412833 +0000 UTC m=+29.297122627" watchObservedRunningTime="2026-09-18 14:51:43.849116821 +0000 UTC m=+29.298826590" Sep 18 14:51:44.072985 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.072951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g2bgv"] Sep 18 14:51:44.073459 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.073171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:44.073459 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:44.073315 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:44.073805 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.073782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qssc6"] Sep 18 14:51:44.073898 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.073869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:44.073978 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:44.073958 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:44.074484 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.074465 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xcln"] Sep 18 14:51:44.074577 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.074566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:44.074662 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:44.074646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:44.199524 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.199477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:44.301751 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.301728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:44.393906 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.393853 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:51:44.820526 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.820498 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d14d620-e790-499c-b590-db8b3c9943e3" containerID="c5e20addd22bd42629e30f9e1bbc46cb4a64543264c16524bcb827704307ae1d" exitCode=0 Sep 18 14:51:44.820692 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:44.820585 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerDied","Data":"c5e20addd22bd42629e30f9e1bbc46cb4a64543264c16524bcb827704307ae1d"} Sep 18 14:51:45.468218 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.468186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:45.587210 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.587163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:45.656386 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.656362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:45.656549 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.656473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:45.656549 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:45.656480 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:45.656549 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.656522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:45.656683 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:45.656618 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:45.656720 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:45.656684 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:45.688340 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.688314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:45.789040 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.789015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:45.889696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:45.889671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.385458 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:46.385393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.767525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:46.767483 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:46.827766 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:46.827741 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d14d620-e790-499c-b590-db8b3c9943e3" containerID="a06af7e8b898864b231feb6b122c8e9fca865b4aefa4e0d91bb4add90d08d92f" exitCode=0 Sep 18 14:51:46.827892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:46.827781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerDied","Data":"a06af7e8b898864b231feb6b122c8e9fca865b4aefa4e0d91bb4add90d08d92f"} Sep 18 14:51:47.171438 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.171371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.361157 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.361061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.554179 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.554153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:47.656476 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.656448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:47.656643 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.656448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:47.656643 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:47.656563 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:47.656643 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.656447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:47.656643 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:47.656632 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:47.656853 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:47.656692 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:47.766923 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:47.766891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:48.769523 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:48.769475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:48.871506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:48.871416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.161968 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.161895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.231389 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.231361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.362932 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.362905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.561169 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.561132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.627648 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.627616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:49.656726 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.656697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:49.656864 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.656704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:49.656864 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:49.656816 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:49.656864 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.656825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:49.657016 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:49.656904 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:49.657016 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:49.656977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:49.766028 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:49.765987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:50.300229 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:50.300200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:50.300668 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:50.300241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:50.300668 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.300344 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:50.300668 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.300404 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs podName:8a182eef-39b5-4828-b477-00556fb11d14 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:22.300388792 +0000 UTC m=+67.750098557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs") pod "network-metrics-daemon-g2bgv" (UID: "8a182eef-39b5-4828-b477-00556fb11d14") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:50.300668 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.300348 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:50.300668 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.300500 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret podName:c9dea73b-2e57-4248-928a-131e3d3756f2 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:22.30047024 +0000 UTC m=+67.750180021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret") pod "global-pull-secret-syncer-qssc6" (UID: "c9dea73b-2e57-4248-928a-131e3d3756f2") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:50.401328 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:50.401297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:50.401515 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.401448 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:50.401515 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.401466 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:50.401515 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.401478 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tv4rn for pod openshift-network-diagnostics/network-check-target-9xcln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:50.401686 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:50.401552 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn podName:e55b445e-9425-475c-8849-0eaa3e185ced nodeName:}" failed. No retries permitted until 2026-09-18 14:52:22.401534293 +0000 UTC m=+67.851244064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv4rn" (UniqueName: "kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn") pod "network-check-target-9xcln" (UID: "e55b445e-9425-475c-8849-0eaa3e185ced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:50.592296 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:50.592224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:50.950260 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:50.950227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:51.364206 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.363985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:51.461405 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.461367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:51.565570 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.565484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:51.656221 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.656196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:51.656320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.656196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:51.656370 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:51.656317 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:51.656370 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.656196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:51.656370 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:51.656364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:51.656541 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:51.656429 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:51.665610 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.665586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:51.765392 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.765369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:51.841596 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.841548 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d14d620-e790-499c-b590-db8b3c9943e3" containerID="0b47fdf197d30d7e61ad5e0c510d787f87c0c4f04b292b4526bc3cf9d8649510" exitCode=0 Sep 18 14:51:51.841670 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:51.841602 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerDied","Data":"0b47fdf197d30d7e61ad5e0c510d787f87c0c4f04b292b4526bc3cf9d8649510"} Sep 18 14:51:52.155830 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:52.155749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.551856 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:52.551818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.753834 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:52.753794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:52.847986 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:52.847915 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d14d620-e790-499c-b590-db8b3c9943e3" containerID="14e0d0691f47ed86f57276c03d452b499bedbfc13967829eadc54df599c6d636" exitCode=0 Sep 18 14:51:52.847986 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:52.847944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerDied","Data":"14e0d0691f47ed86f57276c03d452b499bedbfc13967829eadc54df599c6d636"} Sep 18 14:51:53.167338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:53.167262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:53.656468 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:53.656443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:53.656468 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:53.656457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:53.657020 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:53.656558 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:53.657020 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:53.656556 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:53.657020 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:53.656625 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:53.657020 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:53.656677 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:53.853034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:53.853006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" event={"ID":"9d14d620-e790-499c-b590-db8b3c9943e3","Type":"ContainerStarted","Data":"59171b69b850dee8086f66bf72e5193c72359579386baed9dc4940cd5f615a82"} Sep 18 14:51:53.984620 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:53.984589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.085381 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:54.085354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.185026 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:54.184998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.359073 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:54.359003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.566107 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:54.566082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.758326 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:54.758303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:54.962055 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:54.962027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.063394 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.063324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.332601 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.332525 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.434031 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.434000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.537251 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.537213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.634469 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.634413 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.656326 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.656307 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:55.656413 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.656339 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:55.656413 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:55.656394 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:55.656478 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.656429 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:55.656530 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:55.656516 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:55.656565 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:55.656548 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:55.758687 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.758660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.860173 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.860150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:55.959935 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:55.959912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.062129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:56.062105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.168613 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:56.168590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.226024 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:56.225966 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.399852 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:56.399828 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:56.810967 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:56.810935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.204450 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:57.204423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:57.656295 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:57.656221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:57.656464 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:57.656221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:57.656464 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:57.656221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:57.656464 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:57.656441 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:57.656664 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:57.656534 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:57.656664 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:57.656314 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:51:57.706421 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:57.706396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:58.130186 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:58.130151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:58.188536 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:58.188504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:59.185127 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:59.185097 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:59.251344 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:59.251319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:51:59.656823 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:59.656752 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:51:59.656947 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:59.656838 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:51:59.656947 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:59.656922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:51:59.657036 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:59.657019 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:51:59.657111 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:51:59.657095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:51:59.657190 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:51:59.657176 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:52:01.656820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:01.656789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:52:01.657262 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:01.656789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:52:01.657262 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:01.656884 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:52:01.657262 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:01.656792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:01.657262 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:01.656970 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:52:01.657262 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:01.657035 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:52:02.998055 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:02.998026 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.097971 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.097943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.197412 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.197387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.298256 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.298200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:03.656831 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.656780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:52:03.656978 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.656781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:03.656978 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:03.656876 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2bgv" podUID="8a182eef-39b5-4828-b477-00556fb11d14" Sep 18 14:52:03.656978 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.656781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:52:03.656978 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:03.656949 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xcln" podUID="e55b445e-9425-475c-8849-0eaa3e185ced" Sep 18 14:52:03.657108 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:03.657009 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qssc6" podUID="c9dea73b-2e57-4248-928a-131e3d3756f2" Sep 18 14:52:03.954902 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.954883 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-100.ec2.internal" event="NodeReady" Sep 18 14:52:03.955019 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:03.954963 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 14:52:04.018385 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.018346 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nvrxj" podStartSLOduration=20.087691876 podStartE2EDuration="48.01833279s" totalImagesPullingTime="27.930640914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:53.898309338 +0000 UTC m=+39.348019107" watchObservedRunningTime="2026-09-18 14:52:04.01833279 +0000 UTC m=+49.468042604" Sep 18 14:52:04.018920 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.018904 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7b26p"] Sep 18 14:52:04.039968 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.039948 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8ljzp"] Sep 18 14:52:04.040078 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.040063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.042411 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.042390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rx7lv\"" Sep 18 14:52:04.042875 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.042856 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 14:52:04.043041 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.043021 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 14:52:04.066048 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.066031 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7b26p"] Sep 18 14:52:04.066126 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.066061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8ljzp"] Sep 18 14:52:04.066160 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.066138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.069680 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.069656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 14:52:04.069773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.069665 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 14:52:04.070065 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.070048 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 14:52:04.070133 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.070123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zs65q\"" Sep 18 14:52:04.070186 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.070164 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 14:52:04.118501 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.118461 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hgj6r"] Sep 18 14:52:04.142136 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.142119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hgj6r"] Sep 18 14:52:04.142225 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.142195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.145848 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.145830 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 14:52:04.145959 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.145934 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 14:52:04.146062 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.146010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-44nxd\"" Sep 18 14:52:04.146249 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.146234 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 14:52:04.207967 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.207917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbrvn\" (UniqueName: \"kubernetes.io/projected/150ca376-fd96-4c2d-8350-3d41673c8885-kube-api-access-xbrvn\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.207967 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.207945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47750d0b-6a21-4141-817e-6207bda466ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.208134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.207971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47750d0b-6a21-4141-817e-6207bda466ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.208134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.207987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/150ca376-fd96-4c2d-8350-3d41673c8885-config-volume\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.208134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.208012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47750d0b-6a21-4141-817e-6207bda466ec-data-volume\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.208134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.208094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150ca376-fd96-4c2d-8350-3d41673c8885-tmp-dir\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.208338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.208142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb4xq\" (UniqueName: \"kubernetes.io/projected/47750d0b-6a21-4141-817e-6207bda466ec-kube-api-access-sb4xq\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.208338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.208175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47750d0b-6a21-4141-817e-6207bda466ec-crio-socket\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.208338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.208203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/150ca376-fd96-4c2d-8350-3d41673c8885-metrics-tls\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.209251 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.209234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.284309 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.284286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.309318 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47750d0b-6a21-4141-817e-6207bda466ec-crio-socket\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309381 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/150ca376-fd96-4c2d-8350-3d41673c8885-metrics-tls\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.309381 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbrvn\" (UniqueName: \"kubernetes.io/projected/150ca376-fd96-4c2d-8350-3d41673c8885-kube-api-access-xbrvn\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.309381 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47750d0b-6a21-4141-817e-6207bda466ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47750d0b-6a21-4141-817e-6207bda466ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/150ca376-fd96-4c2d-8350-3d41673c8885-config-volume\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47750d0b-6a21-4141-817e-6207bda466ec-data-volume\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150ca376-fd96-4c2d-8350-3d41673c8885-tmp-dir\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb4xq\" (UniqueName: \"kubernetes.io/projected/47750d0b-6a21-4141-817e-6207bda466ec-kube-api-access-sb4xq\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47750d0b-6a21-4141-817e-6207bda466ec-crio-socket\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13b930e-ba98-43ac-a9dd-daedaa617cc1-cert\") pod \"ingress-canary-hgj6r\" (UID: \"f13b930e-ba98-43ac-a9dd-daedaa617cc1\") " pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.309892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwzz\" (UniqueName: \"kubernetes.io/projected/f13b930e-ba98-43ac-a9dd-daedaa617cc1-kube-api-access-5pwzz\") pod \"ingress-canary-hgj6r\" (UID: \"f13b930e-ba98-43ac-a9dd-daedaa617cc1\") " pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.309892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47750d0b-6a21-4141-817e-6207bda466ec-data-volume\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.309892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.309884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150ca376-fd96-4c2d-8350-3d41673c8885-tmp-dir\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.310059 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.310042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/150ca376-fd96-4c2d-8350-3d41673c8885-config-volume\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.310110 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.310082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47750d0b-6a21-4141-817e-6207bda466ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.313198 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.313174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47750d0b-6a21-4141-817e-6207bda466ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.313258 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.313190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/150ca376-fd96-4c2d-8350-3d41673c8885-metrics-tls\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.317015 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.316996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb4xq\" (UniqueName: \"kubernetes.io/projected/47750d0b-6a21-4141-817e-6207bda466ec-kube-api-access-sb4xq\") pod \"insights-runtime-extractor-8ljzp\" (UID: \"47750d0b-6a21-4141-817e-6207bda466ec\") " pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.318090 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.318071 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbrvn\" (UniqueName: \"kubernetes.io/projected/150ca376-fd96-4c2d-8350-3d41673c8885-kube-api-access-xbrvn\") pod \"dns-default-7b26p\" (UID: \"150ca376-fd96-4c2d-8350-3d41673c8885\") " pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.350002 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.349977 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:04.374137 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.374118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8ljzp" Sep 18 14:52:04.410800 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.410776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13b930e-ba98-43ac-a9dd-daedaa617cc1-cert\") pod \"ingress-canary-hgj6r\" (UID: \"f13b930e-ba98-43ac-a9dd-daedaa617cc1\") " pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.410880 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.410813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwzz\" (UniqueName: \"kubernetes.io/projected/f13b930e-ba98-43ac-a9dd-daedaa617cc1-kube-api-access-5pwzz\") pod \"ingress-canary-hgj6r\" (UID: \"f13b930e-ba98-43ac-a9dd-daedaa617cc1\") " pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.413333 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.413310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13b930e-ba98-43ac-a9dd-daedaa617cc1-cert\") pod \"ingress-canary-hgj6r\" (UID: \"f13b930e-ba98-43ac-a9dd-daedaa617cc1\") " pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.419818 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.419797 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwzz\" (UniqueName: \"kubernetes.io/projected/f13b930e-ba98-43ac-a9dd-daedaa617cc1-kube-api-access-5pwzz\") pod \"ingress-canary-hgj6r\" (UID: \"f13b930e-ba98-43ac-a9dd-daedaa617cc1\") " pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.449662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.449636 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgj6r" Sep 18 14:52:04.553625 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.553599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.617235 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.617213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:04.684992 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.684966 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8ljzp"] Sep 18 14:52:04.688202 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.688138 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7b26p"] Sep 18 14:52:04.689182 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:04.689160 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47750d0b_6a21_4141_817e_6207bda466ec.slice/crio-f901853f2a7d140dd58890a7e06ac81f300797107f1b8f264e8726301eb9bdb3 WatchSource:0}: Error finding container f901853f2a7d140dd58890a7e06ac81f300797107f1b8f264e8726301eb9bdb3: Status 404 returned error can't find the container with id f901853f2a7d140dd58890a7e06ac81f300797107f1b8f264e8726301eb9bdb3 Sep 18 14:52:04.691252 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:04.691229 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150ca376_fd96_4c2d_8350_3d41673c8885.slice/crio-c61c1954b36379348204cb0fec771fcc32f92046868879bae4502011b671e05c WatchSource:0}: Error finding container c61c1954b36379348204cb0fec771fcc32f92046868879bae4502011b671e05c: Status 404 returned error can't find the container with id c61c1954b36379348204cb0fec771fcc32f92046868879bae4502011b671e05c Sep 18 14:52:04.738892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.738872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hgj6r"] Sep 18 14:52:04.743527 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:04.743502 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13b930e_ba98_43ac_a9dd_daedaa617cc1.slice/crio-33064d7a3d2cfcff0d6adf3b6569e64a6c586938be5138c35787d762bf8d6145 WatchSource:0}: Error finding container 33064d7a3d2cfcff0d6adf3b6569e64a6c586938be5138c35787d762bf8d6145: Status 404 returned error can't find the container with id 33064d7a3d2cfcff0d6adf3b6569e64a6c586938be5138c35787d762bf8d6145 Sep 18 14:52:04.875876 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.875836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hgj6r" event={"ID":"f13b930e-ba98-43ac-a9dd-daedaa617cc1","Type":"ContainerStarted","Data":"33064d7a3d2cfcff0d6adf3b6569e64a6c586938be5138c35787d762bf8d6145"} Sep 18 14:52:04.877227 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.877207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ljzp" event={"ID":"47750d0b-6a21-4141-817e-6207bda466ec","Type":"ContainerStarted","Data":"1663ddfe8857394960e4bc605eda50e8b3d03bd0bf983571ce962dfea934d162"} Sep 18 14:52:04.877333 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.877256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ljzp" event={"ID":"47750d0b-6a21-4141-817e-6207bda466ec","Type":"ContainerStarted","Data":"f901853f2a7d140dd58890a7e06ac81f300797107f1b8f264e8726301eb9bdb3"} Sep 18 14:52:04.878207 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:04.878191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7b26p" event={"ID":"150ca376-fd96-4c2d-8350-3d41673c8885","Type":"ContainerStarted","Data":"c61c1954b36379348204cb0fec771fcc32f92046868879bae4502011b671e05c"} Sep 18 14:52:05.656250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.656216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:52:05.656731 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.656475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:05.656803 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.656757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:52:05.659773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.659747 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 14:52:05.660809 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.660664 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 14:52:05.660809 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.660695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdtc\"" Sep 18 14:52:05.660809 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.660715 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 14:52:05.660809 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.660798 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 14:52:05.661077 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:05.660808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cjrmt\"" Sep 18 14:52:06.777117 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.777032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:06.882106 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.882075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:06.885297 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.885268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ljzp" event={"ID":"47750d0b-6a21-4141-817e-6207bda466ec","Type":"ContainerStarted","Data":"f2f74fcfef6159a4f6df412a368e86600a0e207f210602979a58e405023bfc23"} Sep 18 14:52:06.967365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.967333 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n"] Sep 18 14:52:06.973235 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.973207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:06.992398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.992374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n"] Sep 18 14:52:06.992552 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.992473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:06.995656 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.995613 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bfhdb\"" Sep 18 14:52:06.995656 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:06.995643 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 14:52:07.032698 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.032639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dcd54acd-bbac-4070-a1d2-446293d83cca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-kv96n\" (UID: \"dcd54acd-bbac-4070-a1d2-446293d83cca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:07.090477 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.090425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:07.133547 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.133523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dcd54acd-bbac-4070-a1d2-446293d83cca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-kv96n\" (UID: \"dcd54acd-bbac-4070-a1d2-446293d83cca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:07.133715 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:07.133696 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 18 14:52:07.133769 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:07.133758 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd54acd-bbac-4070-a1d2-446293d83cca-tls-certificates podName:dcd54acd-bbac-4070-a1d2-446293d83cca nodeName:}" failed. No retries permitted until 2026-09-18 14:52:07.633744035 +0000 UTC m=+53.083453789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/dcd54acd-bbac-4070-a1d2-446293d83cca-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-kv96n" (UID: "dcd54acd-bbac-4070-a1d2-446293d83cca") : secret "prometheus-operator-admission-webhook-tls" not found Sep 18 14:52:07.198410 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.198374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:07.289139 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.289015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:07.389310 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.389280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:07.637701 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.637674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dcd54acd-bbac-4070-a1d2-446293d83cca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-kv96n\" (UID: \"dcd54acd-bbac-4070-a1d2-446293d83cca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:07.640044 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.640017 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dcd54acd-bbac-4070-a1d2-446293d83cca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-kv96n\" (UID: \"dcd54acd-bbac-4070-a1d2-446293d83cca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:07.891459 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.891422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7b26p" event={"ID":"150ca376-fd96-4c2d-8350-3d41673c8885","Type":"ContainerStarted","Data":"676562d9e634d3d54f58fe0f8deea1cf8799a64a21b83ea667af84e8d3c0290f"} Sep 18 14:52:07.891862 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.891606 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:07.891862 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.891637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7b26p" event={"ID":"150ca376-fd96-4c2d-8350-3d41673c8885","Type":"ContainerStarted","Data":"ba145fcd669b5246350b797401d6fc4e3602651d5d74b949344d5421d51d5d12"} Sep 18 14:52:07.893710 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.893659 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hgj6r" event={"ID":"f13b930e-ba98-43ac-a9dd-daedaa617cc1","Type":"ContainerStarted","Data":"df1fc8168cb6ca9c7f9be6d7dacd233d93a041a3da930996523e0aa0922df226"} Sep 18 14:52:07.902520 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.902479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:07.914191 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.914086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7b26p" podStartSLOduration=2.180327375 podStartE2EDuration="4.9140679s" totalImagesPullingTime="2.733740525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:07.913404564 +0000 UTC m=+53.363114370" watchObservedRunningTime="2026-09-18 14:52:07.9140679 +0000 UTC m=+53.363777671" Sep 18 14:52:07.930271 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:07.930220 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hgj6r" podStartSLOduration=0.952659823 podStartE2EDuration="3.930201973s" totalImagesPullingTime="2.97754215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:07.928802797 +0000 UTC m=+53.378512570" watchObservedRunningTime="2026-09-18 14:52:07.930201973 +0000 UTC m=+53.379911746" Sep 18 14:52:08.040183 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.040153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:08.071634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.071600 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65fcbcbb44-grr62"] Sep 18 14:52:08.093322 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.093253 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fcbcbb44-grr62"] Sep 18 14:52:08.093452 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.093360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.096102 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096074 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bc74j\"" Sep 18 14:52:08.096102 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096088 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 14:52:08.096554 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096358 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 14:52:08.096554 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 14:52:08.096788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096775 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 14:52:08.096963 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096943 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 14:52:08.097040 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096995 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 14:52:08.097109 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.096954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 14:52:08.119754 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.119727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:08.140293 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.140270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-serving-cert\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.140367 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.140307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-console-config\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.140367 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.140337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-oauth-config\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.140447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.140405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-oauth-serving-cert\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.140485 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.140465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-service-ca\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.140543 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.140502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hj8\" (UniqueName: \"kubernetes.io/projected/74041009-2df6-4edc-822e-629b9ce218cf-kube-api-access-q4hj8\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.208253 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.208226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n"] Sep 18 14:52:08.240891 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.240866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-oauth-config\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.240989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.240896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-oauth-serving-cert\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.240989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.240921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-service-ca\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.240989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.240953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hj8\" (UniqueName: \"kubernetes.io/projected/74041009-2df6-4edc-822e-629b9ce218cf-kube-api-access-q4hj8\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.241111 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.241006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-serving-cert\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.241111 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.241053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-console-config\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.241752 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.241728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-oauth-serving-cert\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.241752 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.241744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-service-ca\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.241896 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.241737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-console-config\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.243459 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.243429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-oauth-config\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.243785 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.243762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-serving-cert\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.252810 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.252792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hj8\" (UniqueName: \"kubernetes.io/projected/74041009-2df6-4edc-822e-629b9ce218cf-kube-api-access-q4hj8\") pod \"console-65fcbcbb44-grr62\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.404537 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.404446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:08.658581 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:08.658515 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd54acd_bbac_4070_a1d2_446293d83cca.slice/crio-bfacf7113b04dc07597a6631eac11cd3e42b11d7893824d2cd3153eb124279cd WatchSource:0}: Error finding container bfacf7113b04dc07597a6631eac11cd3e42b11d7893824d2cd3153eb124279cd: Status 404 returned error can't find the container with id bfacf7113b04dc07597a6631eac11cd3e42b11d7893824d2cd3153eb124279cd Sep 18 14:52:08.899112 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.899071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" event={"ID":"dcd54acd-bbac-4070-a1d2-446293d83cca","Type":"ContainerStarted","Data":"bfacf7113b04dc07597a6631eac11cd3e42b11d7893824d2cd3153eb124279cd"} Sep 18 14:52:08.925650 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:08.925623 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fcbcbb44-grr62"] Sep 18 14:52:08.988396 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:08.988368 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74041009_2df6_4edc_822e_629b9ce218cf.slice/crio-6e8ec612520a0395c1e72becb4bafe5129a72d3e99a5a4045c2819131b671770 WatchSource:0}: Error finding container 6e8ec612520a0395c1e72becb4bafe5129a72d3e99a5a4045c2819131b671770: Status 404 returned error can't find the container with id 6e8ec612520a0395c1e72becb4bafe5129a72d3e99a5a4045c2819131b671770 Sep 18 14:52:09.905046 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:09.904943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fcbcbb44-grr62" event={"ID":"74041009-2df6-4edc-822e-629b9ce218cf","Type":"ContainerStarted","Data":"6e8ec612520a0395c1e72becb4bafe5129a72d3e99a5a4045c2819131b671770"} Sep 18 14:52:09.908474 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:09.907909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ljzp" event={"ID":"47750d0b-6a21-4141-817e-6207bda466ec","Type":"ContainerStarted","Data":"2f263e938d1f710d259f6af201f753d4e05ccfdabd48830a0997a9bcf168339e"} Sep 18 14:52:09.934028 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:09.933764 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8ljzp" podStartSLOduration=2.841074522 podStartE2EDuration="6.933746044s" totalImagesPullingTime="4.092671522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:52:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:09.933696193 +0000 UTC m=+55.383405955" watchObservedRunningTime="2026-09-18 14:52:09.933746044 +0000 UTC m=+55.383455812" Sep 18 14:52:10.435205 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.435170 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cbbfbf47b-l2qms"] Sep 18 14:52:10.450831 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.450810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.451270 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.451247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cbbfbf47b-l2qms"] Sep 18 14:52:10.451904 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.451860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:10.458511 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-serving-cert\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.458640 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-service-ca\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.458640 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-console-config\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.458640 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-oauth-config\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.458844 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-oauth-serving-cert\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.458844 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc8lr\" (UniqueName: \"kubernetes.io/projected/c6bb90af-0d22-40a6-9624-a60f69938290-kube-api-access-vc8lr\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.458844 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.458715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-trusted-ca-bundle\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.459125 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.459081 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 14:52:10.547291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.547216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:10.559734 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.559704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-oauth-config\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.559903 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.559882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-oauth-serving-cert\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.559979 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.559913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc8lr\" (UniqueName: \"kubernetes.io/projected/c6bb90af-0d22-40a6-9624-a60f69938290-kube-api-access-vc8lr\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.559979 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.559944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-trusted-ca-bundle\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.560081 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.559988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-serving-cert\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.560219 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.560189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-service-ca\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.560305 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.560268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-console-config\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.560734 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.560707 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-oauth-serving-cert\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.560979 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.560955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-service-ca\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.561121 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.561093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-console-config\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.561869 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.561845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-trusted-ca-bundle\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.562677 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.562656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-oauth-config\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.563135 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.563089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-serving-cert\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.570803 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.570783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc8lr\" (UniqueName: \"kubernetes.io/projected/c6bb90af-0d22-40a6-9624-a60f69938290-kube-api-access-vc8lr\") pod \"console-7cbbfbf47b-l2qms\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.761824 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.761787 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:10.914170 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.914132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" event={"ID":"dcd54acd-bbac-4070-a1d2-446293d83cca","Type":"ContainerStarted","Data":"6ddfe22320256937c3c4e7ee6572f80e98bcfb6bc399ddbabf3e36fa452d08d4"} Sep 18 14:52:10.914620 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.914505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:10.920030 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.920006 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" Sep 18 14:52:10.930174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:10.930129 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-kv96n" podStartSLOduration=3.359829253 podStartE2EDuration="4.930111675s" totalImagesPullingTime="1.570282422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:10.92893179 +0000 UTC m=+56.378641561" watchObservedRunningTime="2026-09-18 14:52:10.930111675 +0000 UTC m=+56.379821448" Sep 18 14:52:11.991253 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:11.991197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:12.026899 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.026865 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm"] Sep 18 14:52:12.091976 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.091941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:12.124891 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.124862 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm"] Sep 18 14:52:12.125037 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.124929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.128544 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.128521 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 14:52:12.128544 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.128535 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 14:52:12.128724 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.128563 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 14:52:12.128724 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.128594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f8sm4\"" Sep 18 14:52:12.128724 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.128539 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 14:52:12.128724 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.128521 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 14:52:12.175339 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.175318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.175460 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.175360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krbf8\" (UniqueName: \"kubernetes.io/projected/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-kube-api-access-krbf8\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.175460 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.175382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.175460 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.175409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.267238 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.267183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:12.276344 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.276323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.276426 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.276363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krbf8\" (UniqueName: \"kubernetes.io/projected/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-kube-api-access-krbf8\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.276426 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.276385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.276426 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.276406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.277068 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.277040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.278666 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.278639 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.278755 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.278742 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.284922 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.284904 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krbf8\" (UniqueName: \"kubernetes.io/projected/e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50-kube-api-access-krbf8\") pod \"prometheus-operator-7bd5d56d6-bqpvm\" (UID: \"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:12.436155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:12.436121 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" Sep 18 14:52:13.714666 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.714585 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cbbfbf47b-l2qms"] Sep 18 14:52:13.717619 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.717594 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm"] Sep 18 14:52:13.717912 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:13.717893 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bb90af_0d22_40a6_9624_a60f69938290.slice/crio-7fe71675293d446f82bea5dcc5de553bf9ffcad980f1b36aadaea6a274331884 WatchSource:0}: Error finding container 7fe71675293d446f82bea5dcc5de553bf9ffcad980f1b36aadaea6a274331884: Status 404 returned error can't find the container with id 7fe71675293d446f82bea5dcc5de553bf9ffcad980f1b36aadaea6a274331884 Sep 18 14:52:13.722246 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:13.722217 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29f2e7d_3fdc_485e_a5e1_6804ef2f5f50.slice/crio-591ef73f2497a5616feb74d88eeff37805a518786da3a8db72ce8529138d523a WatchSource:0}: Error finding container 591ef73f2497a5616feb74d88eeff37805a518786da3a8db72ce8529138d523a: Status 404 returned error can't find the container with id 591ef73f2497a5616feb74d88eeff37805a518786da3a8db72ce8529138d523a Sep 18 14:52:13.925598 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.925563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fcbcbb44-grr62" event={"ID":"74041009-2df6-4edc-822e-629b9ce218cf","Type":"ContainerStarted","Data":"be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349"} Sep 18 14:52:13.927241 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.927218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbbfbf47b-l2qms" event={"ID":"c6bb90af-0d22-40a6-9624-a60f69938290","Type":"ContainerStarted","Data":"f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2"} Sep 18 14:52:13.927374 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.927262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbbfbf47b-l2qms" event={"ID":"c6bb90af-0d22-40a6-9624-a60f69938290","Type":"ContainerStarted","Data":"7fe71675293d446f82bea5dcc5de553bf9ffcad980f1b36aadaea6a274331884"} Sep 18 14:52:13.928397 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.928376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" event={"ID":"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50","Type":"ContainerStarted","Data":"591ef73f2497a5616feb74d88eeff37805a518786da3a8db72ce8529138d523a"} Sep 18 14:52:13.944549 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.944508 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65fcbcbb44-grr62" podStartSLOduration=1.430599821 podStartE2EDuration="5.944474361s" totalImagesPullingTime="4.51387454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:13.944079409 +0000 UTC m=+59.393789178" watchObservedRunningTime="2026-09-18 14:52:13.944474361 +0000 UTC m=+59.394184130" Sep 18 14:52:13.963505 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:13.963459 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cbbfbf47b-l2qms" podStartSLOduration=3.963445147 podStartE2EDuration="3.963445147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:13.963061165 +0000 UTC m=+59.412770935" watchObservedRunningTime="2026-09-18 14:52:13.963445147 +0000 UTC m=+59.413154917" Sep 18 14:52:14.183931 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:14.183889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:14.282261 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:14.282228 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:15.326409 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:15.326324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:15.833484 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:15.833456 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngtnw" Sep 18 14:52:15.935981 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:15.935941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" event={"ID":"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50","Type":"ContainerStarted","Data":"3618a136609b0e41def4ab1a2d4a8c67fa098db4738abb1674e0da44903d5009"} Sep 18 14:52:15.936123 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:15.935992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" event={"ID":"e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50","Type":"ContainerStarted","Data":"4b57a00aa16e67798473eab0f2b13245eed65832a3b3c0cdd89b2551c9879433"} Sep 18 14:52:15.953721 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:15.953676 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-bqpvm" podStartSLOduration=2.702767757 podStartE2EDuration="3.95366068s" totalImagesPullingTime="1.250892923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:15.952885079 +0000 UTC m=+61.402594873" watchObservedRunningTime="2026-09-18 14:52:15.95366068 +0000 UTC m=+61.403370450" Sep 18 14:52:15.981474 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:15.981450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:16.058627 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:16.058602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.145378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.145339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.373015 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.372979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.389352 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.389330 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq"] Sep 18 14:52:17.393456 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.393440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.395646 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.395593 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ntnb5\"" Sep 18 14:52:17.395757 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.395706 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 14:52:17.396030 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.396016 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 14:52:17.402210 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.402189 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mcgbd"] Sep 18 14:52:17.405015 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.405000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq"] Sep 18 14:52:17.405091 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.405082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.407435 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.407412 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 14:52:17.407549 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.407440 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7mpl9\"" Sep 18 14:52:17.407549 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.407455 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 14:52:17.407770 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.407754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 14:52:17.409418 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.409068 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-69m5d"] Sep 18 14:52:17.412403 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.412384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.414623 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.414607 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 14:52:17.414704 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.414639 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 14:52:17.414756 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.414704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vq8rz\"" Sep 18 14:52:17.414756 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.414710 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 14:52:17.416228 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.416208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.416310 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.416262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4fmf\" (UniqueName: \"kubernetes.io/projected/b95b55ac-409f-494b-9558-1b518e698058-kube-api-access-b4fmf\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.416374 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.416354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.416425 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.416390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b95b55ac-409f-494b-9558-1b518e698058-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.431660 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.431639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-69m5d"] Sep 18 14:52:17.461070 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.461046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.517499 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ace159c2-8081-4c52-8454-ac84cb1dac4f-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.517599 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ace159c2-8081-4c52-8454-ac84cb1dac4f-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.517599 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-root\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.517599 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-tls\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.517706 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f69z\" (UniqueName: \"kubernetes.io/projected/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-api-access-2f69z\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.517706 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-metrics-client-ca\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.517706 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.517706 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.517706 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.517868 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.517868 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.517868 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4fmf\" (UniqueName: \"kubernetes.io/projected/b95b55ac-409f-494b-9558-1b518e698058-kube-api-access-b4fmf\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.517868 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-wtmp\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.518046 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.518046 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.518046 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.517955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b95b55ac-409f-494b-9558-1b518e698058-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.518189 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:17.518051 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 14:52:17.518189 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.518071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-sys\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.518189 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:17.518093 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-tls podName:b95b55ac-409f-494b-9558-1b518e698058 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:18.018080977 +0000 UTC m=+63.467790725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-cqmmq" (UID: "b95b55ac-409f-494b-9558-1b518e698058") : secret "openshift-state-metrics-tls" not found Sep 18 14:52:17.518189 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.518140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-textfile\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.518189 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.518172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjqw\" (UniqueName: \"kubernetes.io/projected/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-kube-api-access-jfjqw\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.518632 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.518611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b95b55ac-409f-494b-9558-1b518e698058-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.520079 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.520062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.526247 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.526221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4fmf\" (UniqueName: \"kubernetes.io/projected/b95b55ac-409f-494b-9558-1b518e698058-kube-api-access-b4fmf\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:17.577768 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.577743 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.618838 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.618818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-sys\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.618914 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.618843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-textfile\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.618914 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.618860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjqw\" (UniqueName: \"kubernetes.io/projected/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-kube-api-access-jfjqw\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.618914 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.618877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ace159c2-8081-4c52-8454-ac84cb1dac4f-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.618914 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.618892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ace159c2-8081-4c52-8454-ac84cb1dac4f-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.619050 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.618920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-sys\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619050 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-root\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619122 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-tls\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619122 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-root\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619543 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f69z\" (UniqueName: \"kubernetes.io/projected/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-api-access-2f69z\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.619543 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-metrics-client-ca\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619664 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619615 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ace159c2-8081-4c52-8454-ac84cb1dac4f-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.619726 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619726 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-textfile\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.619823 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.619881 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.619936 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.619989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.619953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-wtmp\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.620037 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.620009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.620088 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.620045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ace159c2-8081-4c52-8454-ac84cb1dac4f-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.620789 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.620231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-wtmp\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.620789 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.620255 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.620789 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.620732 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.620995 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.620687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-metrics-client-ca\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.622657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.622208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-tls\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.622760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.622736 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.625252 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.625223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.625365 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.625347 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.632355 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.632338 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjqw\" (UniqueName: \"kubernetes.io/projected/85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d-kube-api-access-jfjqw\") pod \"node-exporter-mcgbd\" (UID: \"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d\") " pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.632827 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.632809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f69z\" (UniqueName: \"kubernetes.io/projected/ace159c2-8081-4c52-8454-ac84cb1dac4f-kube-api-access-2f69z\") pod \"kube-state-metrics-84c885658c-69m5d\" (UID: \"ace159c2-8081-4c52-8454-ac84cb1dac4f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.677905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.677883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.714589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.714567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcgbd" Sep 18 14:52:17.721584 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.721567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" Sep 18 14:52:17.726527 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:17.726505 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c0cbc1_dc71_4edf_b4ed_9b6f49ab1e6d.slice/crio-234b4e7e8c0e780f545b0030b8627c25a89167f2b1e78c786ecd29898f46d3f6 WatchSource:0}: Error finding container 234b4e7e8c0e780f545b0030b8627c25a89167f2b1e78c786ecd29898f46d3f6: Status 404 returned error can't find the container with id 234b4e7e8c0e780f545b0030b8627c25a89167f2b1e78c786ecd29898f46d3f6 Sep 18 14:52:17.779608 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.779582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:17.901570 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.901546 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7b26p" Sep 18 14:52:17.943653 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.943583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcgbd" event={"ID":"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d","Type":"ContainerStarted","Data":"234b4e7e8c0e780f545b0030b8627c25a89167f2b1e78c786ecd29898f46d3f6"} Sep 18 14:52:17.994272 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:17.994241 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-69m5d"] Sep 18 14:52:17.996864 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:17.996830 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace159c2_8081_4c52_8454_ac84cb1dac4f.slice/crio-9246d305e7399afdd3e7d594c740f84ceac29a4444f32f4ccd07e5096c72ad4f WatchSource:0}: Error finding container 9246d305e7399afdd3e7d594c740f84ceac29a4444f32f4ccd07e5096c72ad4f: Status 404 returned error can't find the container with id 9246d305e7399afdd3e7d594c740f84ceac29a4444f32f4ccd07e5096c72ad4f Sep 18 14:52:18.023817 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.023792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:18.025872 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.025853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b95b55ac-409f-494b-9558-1b518e698058-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-cqmmq\" (UID: \"b95b55ac-409f-494b-9558-1b518e698058\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:18.302943 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.302874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" Sep 18 14:52:18.399284 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.399187 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:18.405233 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.405207 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:18.405345 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.405263 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:18.406354 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.406329 2581 patch_prober.go:28] interesting pod/console-65fcbcbb44-grr62 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Sep 18 14:52:18.406434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.406371 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fcbcbb44-grr62" podUID="74041009-2df6-4edc-822e-629b9ce218cf" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Sep 18 14:52:18.485594 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.485557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:18.489993 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.489968 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:52:18.495156 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.495130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.498250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.497883 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 14:52:18.498250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.497988 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 14:52:18.498250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.497988 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 14:52:18.498250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.498098 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 14:52:18.498250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.497993 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 14:52:18.498250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.498173 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 14:52:18.498678 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.498362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 14:52:18.498678 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.498429 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 14:52:18.498678 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.498366 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 14:52:18.498678 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.498467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-btb5w\"" Sep 18 14:52:18.512238 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.512204 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:52:18.527691 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.527667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.527800 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.527763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.527922 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.527898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528044 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.527954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skl5k\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-kube-api-access-skl5k\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528044 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.527981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-config-volume\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528044 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528044 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528237 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528237 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528237 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-web-config\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528389 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-config-out\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528389 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.528389 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.528354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.589074 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.589014 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq"] Sep 18 14:52:18.591614 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:18.591587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95b55ac_409f_494b_9558_1b518e698058.slice/crio-10c2b0beba45c4dbac45b5846d2ab9051286fa537afc3149507c11b671408e13 WatchSource:0}: Error finding container 10c2b0beba45c4dbac45b5846d2ab9051286fa537afc3149507c11b671408e13: Status 404 returned error can't find the container with id 10c2b0beba45c4dbac45b5846d2ab9051286fa537afc3149507c11b671408e13 Sep 18 14:52:18.592522 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.592470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:18.629339 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-config-out\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.629434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.629434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.629610 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.629693 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skl5k\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-kube-api-access-skl5k\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-config-volume\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.629978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.630022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.630074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.630109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.630148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-web-config\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630755 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.630429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630755 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.630574 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.630755 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:18.630704 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle podName:53732f6b-b120-4320-a298-d0360baa2c81 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:19.13068451 +0000 UTC m=+64.580394257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "53732f6b-b120-4320-a298-d0360baa2c81") : configmap references non-existent config key: ca-bundle.crt Sep 18 14:52:18.634078 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.633668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.634078 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.633965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.634226 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.634179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-config-out\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.634758 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.634712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.635037 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.634880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.635948 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.635588 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.635948 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.635765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-web-config\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.636080 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.635984 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-config-volume\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.636385 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.636369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.639997 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.639976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skl5k\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-kube-api-access-skl5k\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:18.839625 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.839558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:18.952677 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.952636 2581 generic.go:356] "Generic (PLEG): container finished" podID="85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d" containerID="c36c09b2da69c1904c57be91ef6ef17b6deb31c2cf5c5ac01fe672ecefa4e200" exitCode=0 Sep 18 14:52:18.952828 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.952727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcgbd" event={"ID":"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d","Type":"ContainerDied","Data":"c36c09b2da69c1904c57be91ef6ef17b6deb31c2cf5c5ac01fe672ecefa4e200"} Sep 18 14:52:18.954916 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.954859 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" event={"ID":"ace159c2-8081-4c52-8454-ac84cb1dac4f","Type":"ContainerStarted","Data":"9246d305e7399afdd3e7d594c740f84ceac29a4444f32f4ccd07e5096c72ad4f"} Sep 18 14:52:18.958033 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.958008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" event={"ID":"b95b55ac-409f-494b-9558-1b518e698058","Type":"ContainerStarted","Data":"7328239e0c2194cdeb8e817085fc7cbabc8bbc263371ce00cedcb28e5c5ff00d"} Sep 18 14:52:18.958173 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.958157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" event={"ID":"b95b55ac-409f-494b-9558-1b518e698058","Type":"ContainerStarted","Data":"e70af990140a8cdc4ddc3bef60b74ab1fe42097d05a9e1d8d6fb8801a772f79f"} Sep 18 14:52:18.958240 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:18.958186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" event={"ID":"b95b55ac-409f-494b-9558-1b518e698058","Type":"ContainerStarted","Data":"10c2b0beba45c4dbac45b5846d2ab9051286fa537afc3149507c11b671408e13"} Sep 18 14:52:19.134697 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.134620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:19.135634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.135607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:19.408132 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.408064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:52:19.425780 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.425756 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h"] Sep 18 14:52:19.431249 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.431234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.434242 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434221 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 14:52:19.434341 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434221 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 14:52:19.434341 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434286 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 14:52:19.434341 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434326 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mj8qc\"" Sep 18 14:52:19.434594 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434576 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 14:52:19.434665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434590 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-edbvcso8c68vp\"" Sep 18 14:52:19.434665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.434608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 14:52:19.447287 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.447267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h"] Sep 18 14:52:19.537746 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.537746 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c319756-c3f0-4002-b7c6-1c1cf164f837-metrics-client-ca\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.537928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-tls\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.537928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-grpc-tls\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.538034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8p6n\" (UniqueName: \"kubernetes.io/projected/0c319756-c3f0-4002-b7c6-1c1cf164f837-kube-api-access-v8p6n\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.538034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.538034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.537998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.538034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.538025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639303 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639303 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639303 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639249 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639303 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c319756-c3f0-4002-b7c6-1c1cf164f837-metrics-client-ca\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-tls\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-grpc-tls\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.639574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.639529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8p6n\" (UniqueName: \"kubernetes.io/projected/0c319756-c3f0-4002-b7c6-1c1cf164f837-kube-api-access-v8p6n\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.640628 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.640456 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c319756-c3f0-4002-b7c6-1c1cf164f837-metrics-client-ca\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.646843 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.646789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.648591 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.647602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-tls\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.648591 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.647986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.648591 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.648559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-grpc-tls\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.649992 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.649947 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.651056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.650623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8p6n\" (UniqueName: \"kubernetes.io/projected/0c319756-c3f0-4002-b7c6-1c1cf164f837-kube-api-access-v8p6n\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.651056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.651004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0c319756-c3f0-4002-b7c6-1c1cf164f837-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b847d7cbb-zrg7h\" (UID: \"0c319756-c3f0-4002-b7c6-1c1cf164f837\") " pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.697552 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.697353 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:52:19.705850 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:19.705820 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53732f6b_b120_4320_a298_d0360baa2c81.slice/crio-2865e2f62b01844fcf8823a6d04d974a938a3aaf7f12f624cf98cd27b167ca0d WatchSource:0}: Error finding container 2865e2f62b01844fcf8823a6d04d974a938a3aaf7f12f624cf98cd27b167ca0d: Status 404 returned error can't find the container with id 2865e2f62b01844fcf8823a6d04d974a938a3aaf7f12f624cf98cd27b167ca0d Sep 18 14:52:19.850134 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.850065 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:19.964172 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.964133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"2865e2f62b01844fcf8823a6d04d974a938a3aaf7f12f624cf98cd27b167ca0d"} Sep 18 14:52:19.966654 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.966625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcgbd" event={"ID":"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d","Type":"ContainerStarted","Data":"eba8649e31816dd603f8a3f397879befabdf1fef8a6f170f06ca7014ef767c7c"} Sep 18 14:52:19.966765 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.966674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcgbd" event={"ID":"85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d","Type":"ContainerStarted","Data":"cd83448a743855363b997c7d00b64c31513137dec7a6e6f80e23267381091b2f"} Sep 18 14:52:19.969107 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.969081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" event={"ID":"ace159c2-8081-4c52-8454-ac84cb1dac4f","Type":"ContainerStarted","Data":"3b70be64f758eb12908dbbe21ffbef6ac0012647d7063cd3c75ad3a92ff0c813"} Sep 18 14:52:19.969212 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.969133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" event={"ID":"ace159c2-8081-4c52-8454-ac84cb1dac4f","Type":"ContainerStarted","Data":"4f111985218d0ffd64efe4f4f34bdfe5cb14799961fe8c15a6d3f15178f493a3"} Sep 18 14:52:19.969212 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.969162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" event={"ID":"ace159c2-8081-4c52-8454-ac84cb1dac4f","Type":"ContainerStarted","Data":"065251c98bc4d78fe7d05b3ed8c52c85202a013edd135103a074272ed0c5f3ea"} Sep 18 14:52:19.985022 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:19.984973 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mcgbd" podStartSLOduration=2.000996917 podStartE2EDuration="2.984956321s" totalImagesPullingTime="912.602885ms" totalInitContainerRuntime="71.356519ms" isStatefulPod=true podCreationTimestamp="2026-09-18 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:19.984473661 +0000 UTC m=+65.434183443" watchObservedRunningTime="2026-09-18 14:52:19.984956321 +0000 UTC m=+65.434666091" Sep 18 14:52:20.002690 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.002649 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-69m5d" podStartSLOduration=1.5855881269999998 podStartE2EDuration="3.00263579s" totalImagesPullingTime="1.417047663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:20.00133648 +0000 UTC m=+65.451046250" watchObservedRunningTime="2026-09-18 14:52:20.00263579 +0000 UTC m=+65.452345567" Sep 18 14:52:20.288278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.288200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h"] Sep 18 14:52:20.291757 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:20.291732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c319756_c3f0_4002_b7c6_1c1cf164f837.slice/crio-6c2b0d44cc4dd304b674ccacdc567283a228a783305d765bf114433d853ebc36 WatchSource:0}: Error finding container 6c2b0d44cc4dd304b674ccacdc567283a228a783305d765bf114433d853ebc36: Status 404 returned error can't find the container with id 6c2b0d44cc4dd304b674ccacdc567283a228a783305d765bf114433d853ebc36 Sep 18 14:52:20.362975 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.362943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.464677 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.464650 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.597131 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.597054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.698299 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.698250 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:20.762727 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.762703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:20.762799 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.762764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:20.768619 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.768595 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:20.974304 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.974273 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0" exitCode=0 Sep 18 14:52:20.974447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.974358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0"} Sep 18 14:52:20.976609 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.976583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" event={"ID":"b95b55ac-409f-494b-9558-1b518e698058","Type":"ContainerStarted","Data":"16627fa0b13a024391e26c1a6f1dd9f8624312cf6de28de29d8ce3946145c8a1"} Sep 18 14:52:20.978175 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.978123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"6c2b0d44cc4dd304b674ccacdc567283a228a783305d765bf114433d853ebc36"} Sep 18 14:52:20.982264 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:20.982248 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:52:21.035832 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.035729 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-cqmmq" podStartSLOduration=2.702927295 podStartE2EDuration="4.035711754s" totalImagesPullingTime="1.332784459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:21.035427463 +0000 UTC m=+66.485137234" watchObservedRunningTime="2026-09-18 14:52:21.035711754 +0000 UTC m=+66.485421534" Sep 18 14:52:21.051684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.051661 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fcbcbb44-grr62"] Sep 18 14:52:21.795540 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.795504 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55c8876dd7-jdqvn"] Sep 18 14:52:21.799307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.799283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.802665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.802537 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 14:52:21.802665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.802557 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 14:52:21.802665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.802560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kgc42\"" Sep 18 14:52:21.802896 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.802682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fk6fnr9jpeide\"" Sep 18 14:52:21.802896 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.802685 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 14:52:21.802896 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.802725 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 14:52:21.809328 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.809305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55c8876dd7-jdqvn"] Sep 18 14:52:21.862572 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-secret-metrics-server-client-certs\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.862711 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-metrics-server-audit-profiles\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.862711 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-client-ca-bundle\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.862818 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lm6\" (UniqueName: \"kubernetes.io/projected/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-kube-api-access-k7lm6\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.862892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-audit-log\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.862892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-secret-metrics-server-tls\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.862982 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.862969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964286 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-secret-metrics-server-client-certs\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964286 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-metrics-server-audit-profiles\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964546 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-client-ca-bundle\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964546 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lm6\" (UniqueName: \"kubernetes.io/projected/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-kube-api-access-k7lm6\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964673 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-audit-log\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964673 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-secret-metrics-server-tls\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.964673 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.964649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.965109 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.965066 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-audit-log\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.965354 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.965307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.965442 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.965393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-metrics-server-audit-profiles\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.967422 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.967398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-secret-metrics-server-client-certs\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.967540 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.967427 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-client-ca-bundle\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.967643 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.967618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-secret-metrics-server-tls\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:21.976302 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:21.976284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lm6\" (UniqueName: \"kubernetes.io/projected/d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a-kube-api-access-k7lm6\") pod \"metrics-server-55c8876dd7-jdqvn\" (UID: \"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a\") " pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:22.112994 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.112923 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:22.164600 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.164559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:22.179834 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.179813 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk"] Sep 18 14:52:22.182924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.182901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.185140 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.185119 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 14:52:22.185230 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.185206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zlrt8\"" Sep 18 14:52:22.193788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.193762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk"] Sep 18 14:52:22.225857 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.225826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:22.267994 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.267967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd63a3a1-61ee-4647-ad52-d236c6295808-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.268129 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.268018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qxk4\" (UniqueName: \"kubernetes.io/projected/fd63a3a1-61ee-4647-ad52-d236c6295808-kube-api-access-4qxk4\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.369292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.369217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:52:22.369292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.369266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd63a3a1-61ee-4647-ad52-d236c6295808-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.369610 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:22.369380 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 14:52:22.369610 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.369417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qxk4\" (UniqueName: \"kubernetes.io/projected/fd63a3a1-61ee-4647-ad52-d236c6295808-kube-api-access-4qxk4\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.369610 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:22.369443 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd63a3a1-61ee-4647-ad52-d236c6295808-monitoring-plugin-cert podName:fd63a3a1-61ee-4647-ad52-d236c6295808 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:22.869426776 +0000 UTC m=+68.319136547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fd63a3a1-61ee-4647-ad52-d236c6295808-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-mtwrk" (UID: "fd63a3a1-61ee-4647-ad52-d236c6295808") : secret "monitoring-plugin-cert" not found Sep 18 14:52:22.369610 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.369484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:52:22.371813 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.371789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 14:52:22.371940 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.371889 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 14:52:22.380713 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.380646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qxk4\" (UniqueName: \"kubernetes.io/projected/fd63a3a1-61ee-4647-ad52-d236c6295808-kube-api-access-4qxk4\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.382449 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.382426 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9dea73b-2e57-4248-928a-131e3d3756f2-original-pull-secret\") pod \"global-pull-secret-syncer-qssc6\" (UID: \"c9dea73b-2e57-4248-928a-131e3d3756f2\") " pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:52:22.382693 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.382644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a182eef-39b5-4828-b477-00556fb11d14-metrics-certs\") pod \"network-metrics-daemon-g2bgv\" (UID: \"8a182eef-39b5-4828-b477-00556fb11d14\") " pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:52:22.470273 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.470245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:22.472275 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.472257 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdtc\"" Sep 18 14:52:22.472444 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.472425 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 14:52:22.480140 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.480123 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2bgv" Sep 18 14:52:22.483374 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.483349 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 14:52:22.483529 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.483514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qssc6" Sep 18 14:52:22.494300 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.494247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4rn\" (UniqueName: \"kubernetes.io/projected/e55b445e-9425-475c-8849-0eaa3e185ced-kube-api-access-tv4rn\") pod \"network-check-target-9xcln\" (UID: \"e55b445e-9425-475c-8849-0eaa3e185ced\") " pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:22.674182 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.674128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:22.743099 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.743032 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55c8876dd7-jdqvn"] Sep 18 14:52:22.747538 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:22.747507 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fe4ec1_c083_4e19_9b5b_9040aff3ab2a.slice/crio-8fdf1c5bbb5de0d1e5521dd237cc60ee3d541229c8413739e5787582210b6663 WatchSource:0}: Error finding container 8fdf1c5bbb5de0d1e5521dd237cc60ee3d541229c8413739e5787582210b6663: Status 404 returned error can't find the container with id 8fdf1c5bbb5de0d1e5521dd237cc60ee3d541229c8413739e5787582210b6663 Sep 18 14:52:22.771344 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.771318 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qssc6"] Sep 18 14:52:22.774176 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:22.774151 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dea73b_2e57_4248_928a_131e3d3756f2.slice/crio-3895beae6de1b2f92b738e1e235e10e450bc826fa25fb881237d627e47b20d1e WatchSource:0}: Error finding container 3895beae6de1b2f92b738e1e235e10e450bc826fa25fb881237d627e47b20d1e: Status 404 returned error can't find the container with id 3895beae6de1b2f92b738e1e235e10e450bc826fa25fb881237d627e47b20d1e Sep 18 14:52:22.775344 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.775224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g2bgv"] Sep 18 14:52:22.777757 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:22.777703 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a182eef_39b5_4828_b477_00556fb11d14.slice/crio-1a95e4f6d8885a1a8bad710cabd902a5fdfc5fdc8a9f04561181fbe5943215cf WatchSource:0}: Error finding container 1a95e4f6d8885a1a8bad710cabd902a5fdfc5fdc8a9f04561181fbe5943215cf: Status 404 returned error can't find the container with id 1a95e4f6d8885a1a8bad710cabd902a5fdfc5fdc8a9f04561181fbe5943215cf Sep 18 14:52:22.778658 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.778631 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cjrmt\"" Sep 18 14:52:22.787685 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.787667 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:22.873593 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.873524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd63a3a1-61ee-4647-ad52-d236c6295808-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.875800 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.875781 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd63a3a1-61ee-4647-ad52-d236c6295808-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mtwrk\" (UID: \"fd63a3a1-61ee-4647-ad52-d236c6295808\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:22.991787 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.991758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d"} Sep 18 14:52:22.991908 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.991846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58"} Sep 18 14:52:22.991908 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.991889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271"} Sep 18 14:52:22.991976 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.991914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d"} Sep 18 14:52:22.991976 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.991943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df"} Sep 18 14:52:22.992909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.992889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2bgv" event={"ID":"8a182eef-39b5-4828-b477-00556fb11d14","Type":"ContainerStarted","Data":"1a95e4f6d8885a1a8bad710cabd902a5fdfc5fdc8a9f04561181fbe5943215cf"} Sep 18 14:52:22.994091 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.994072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" event={"ID":"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a","Type":"ContainerStarted","Data":"8fdf1c5bbb5de0d1e5521dd237cc60ee3d541229c8413739e5787582210b6663"} Sep 18 14:52:22.996190 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.996173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"912c274d7acd2d188bc7e16ee60a285a682ffc7190b7b58a42f6ad9686e72765"} Sep 18 14:52:22.996242 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.996228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"22226f866a3ca7d8527ffaf47eff864d2cf8765087cf892a9d90360361f71fc7"} Sep 18 14:52:22.996285 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.996271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"411ec5d42219ce5d0180aad48e1d822966ca5638ede6baf48a396b48b9da69c8"} Sep 18 14:52:22.998987 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:22.998964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qssc6" event={"ID":"c9dea73b-2e57-4248-928a-131e3d3756f2","Type":"ContainerStarted","Data":"3895beae6de1b2f92b738e1e235e10e450bc826fa25fb881237d627e47b20d1e"} Sep 18 14:52:23.064077 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.064056 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xcln"] Sep 18 14:52:23.066433 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:23.066404 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55b445e_9425_475c_8849_0eaa3e185ced.slice/crio-3087fff69c46c31e467e74a0f2708dfbd2d84aeed445321866e184692ce46c0b WatchSource:0}: Error finding container 3087fff69c46c31e467e74a0f2708dfbd2d84aeed445321866e184692ce46c0b: Status 404 returned error can't find the container with id 3087fff69c46c31e467e74a0f2708dfbd2d84aeed445321866e184692ce46c0b Sep 18 14:52:23.087750 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.087730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.094659 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.094639 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:23.190548 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.190517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.365334 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.365239 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk"] Sep 18 14:52:23.578254 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:23.578210 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd63a3a1_61ee_4647_ad52_d236c6295808.slice/crio-d8d185b5704f969a84df5cb28bcd6f86db2e6a43894ce3b53473d6416350c7dc WatchSource:0}: Error finding container d8d185b5704f969a84df5cb28bcd6f86db2e6a43894ce3b53473d6416350c7dc: Status 404 returned error can't find the container with id d8d185b5704f969a84df5cb28bcd6f86db2e6a43894ce3b53473d6416350c7dc Sep 18 14:52:23.717480 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.717456 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:52:23.724019 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.724000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.729338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.729144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 14:52:23.729414 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.729366 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xnkk4\"" Sep 18 14:52:23.731321 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.729934 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 14:52:23.731321 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.730173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 14:52:23.731819 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.731797 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.732019 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.732261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.732465 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.732675 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.732857 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.733046 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.733194 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.734530 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 14:52:23.736506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.734732 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-63bnvudrg2ge9\"" Sep 18 14:52:23.743749 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.741330 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:52:23.743749 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.742085 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 14:52:23.743749 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.742431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 14:52:23.746951 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.746927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-config\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftn6b\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-kube-api-access-ftn6b\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.784924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.784959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-web-config\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-config-out\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.785589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.785361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.886106 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.885945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-web-config\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.886106 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.886011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.886106 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.886043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-config-out\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.887814 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-config\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftn6b\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-kube-api-access-ftn6b\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.888655 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.889094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.889094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.889094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.888725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.894503 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.893075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.894503 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.894182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.896820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.895921 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.896820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.896537 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.898007 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.897699 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.898007 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.897724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.898393 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.898235 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.899012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.898782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.900104 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.899510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.901877 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.901723 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.901877 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.901844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-web-config\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.902544 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.902027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.902544 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.902307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-config-out\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.902773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.902696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-config\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.902773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.902734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.903404 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.902909 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.903537 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.903404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.903954 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.903911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:23.906480 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:23.906455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftn6b\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-kube-api-access-ftn6b\") pod \"prometheus-k8s-0\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:24.017259 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.017019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"4b986a61255905931914e07dbb434b4091e1800bbce1576b4cf8616f197d1ea9"} Sep 18 14:52:24.017259 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.017106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"5d1a777fafaaa51856a5d20a97f16eefb6bebc71648249dadfd0179eef6d6841"} Sep 18 14:52:24.019913 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.019850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xcln" event={"ID":"e55b445e-9425-475c-8849-0eaa3e185ced","Type":"ContainerStarted","Data":"3087fff69c46c31e467e74a0f2708dfbd2d84aeed445321866e184692ce46c0b"} Sep 18 14:52:24.030605 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.029581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerStarted","Data":"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f"} Sep 18 14:52:24.032393 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.032344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" event={"ID":"fd63a3a1-61ee-4647-ad52-d236c6295808","Type":"ContainerStarted","Data":"d8d185b5704f969a84df5cb28bcd6f86db2e6a43894ce3b53473d6416350c7dc"} Sep 18 14:52:24.057708 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.057475 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.660632267 podStartE2EDuration="6.057455495s" totalImagesPullingTime="3.38178148s" totalInitContainerRuntime="15.041748ms" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:24.054986401 +0000 UTC m=+69.504696171" watchObservedRunningTime="2026-09-18 14:52:24.057455495 +0000 UTC m=+69.507165278" Sep 18 14:52:24.073955 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.073699 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:24.566412 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:24.566344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.445695 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.445667 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-654d6dcf8-278mc"] Sep 18 14:52:25.449844 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.449824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.450367 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.450346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.462917 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.462892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654d6dcf8-278mc"] Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-config\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-trusted-ca-bundle\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-oauth-serving-cert\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vnm\" (UniqueName: \"kubernetes.io/projected/e343528a-e7f3-4b2b-9236-fc80988efc2a-kube-api-access-78vnm\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-oauth-config\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-serving-cert\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.509401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.509254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-service-ca\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.551231 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.551062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-serving-cert\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-service-ca\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-config\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-trusted-ca-bundle\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-oauth-serving-cert\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vnm\" (UniqueName: \"kubernetes.io/projected/e343528a-e7f3-4b2b-9236-fc80988efc2a-kube-api-access-78vnm\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.610675 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.610533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-oauth-config\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.611375 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.611212 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-config\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.612286 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.612258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-oauth-serving-cert\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.613154 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.613061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-trusted-ca-bundle\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.614231 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.614153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-service-ca\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.614757 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.614730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-serving-cert\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.619227 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.619173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-oauth-config\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.622234 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.622215 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vnm\" (UniqueName: \"kubernetes.io/projected/e343528a-e7f3-4b2b-9236-fc80988efc2a-kube-api-access-78vnm\") pod \"console-654d6dcf8-278mc\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:25.650296 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.650231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:25.725153 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.725029 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:52:25.728647 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:25.728613 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe79f74_7c93_4725_b1a7_78b324270dac.slice/crio-5f1a777ce1c5ebad907a6783acc582474ba0dbcc4583b79504162bcc5b97cf05 WatchSource:0}: Error finding container 5f1a777ce1c5ebad907a6783acc582474ba0dbcc4583b79504162bcc5b97cf05: Status 404 returned error can't find the container with id 5f1a777ce1c5ebad907a6783acc582474ba0dbcc4583b79504162bcc5b97cf05 Sep 18 14:52:25.781000 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:25.780970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:26.048718 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.048636 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" event={"ID":"0c319756-c3f0-4002-b7c6-1c1cf164f837","Type":"ContainerStarted","Data":"b668c98c709447d877598bbd7164bd54562f95c1f63f17083c6b9e1bc2d437ab"} Sep 18 14:52:26.048888 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.048764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:26.050817 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.050793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" event={"ID":"fd63a3a1-61ee-4647-ad52-d236c6295808","Type":"ContainerStarted","Data":"7acd7517ba36b3e5c0eb85335e5b6a0ce05282af4ce786e5362d7ba6e823fe85"} Sep 18 14:52:26.051068 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.050962 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:26.053804 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.053756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" event={"ID":"d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a","Type":"ContainerStarted","Data":"ff42bf746d6f132954fdf61d7a265dbfbfd9b968c04c87737b20af1d5d9469ab"} Sep 18 14:52:26.056921 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.056850 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" exitCode=0 Sep 18 14:52:26.057056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.056979 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} Sep 18 14:52:26.057056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.057041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"5f1a777ce1c5ebad907a6783acc582474ba0dbcc4583b79504162bcc5b97cf05"} Sep 18 14:52:26.057300 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.057281 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" Sep 18 14:52:26.059716 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.059694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2bgv" event={"ID":"8a182eef-39b5-4828-b477-00556fb11d14","Type":"ContainerStarted","Data":"4d74c185b05592b990ad2ad106878d0a3d68c9c77dd58f90891723edf47d2248"} Sep 18 14:52:26.059858 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.059836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2bgv" event={"ID":"8a182eef-39b5-4828-b477-00556fb11d14","Type":"ContainerStarted","Data":"af4ea34d77bbaf0a07d851a7eb66f7a773346455bd42efb79143253d3e389d46"} Sep 18 14:52:26.073670 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.073455 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" podStartSLOduration=3.982007044 podStartE2EDuration="7.073437507s" totalImagesPullingTime="3.091430463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:26.07229998 +0000 UTC m=+71.522009750" watchObservedRunningTime="2026-09-18 14:52:26.073437507 +0000 UTC m=+71.523147277" Sep 18 14:52:26.077233 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.077127 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654d6dcf8-278mc"] Sep 18 14:52:26.093394 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.093344 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" podStartSLOduration=2.414023145 podStartE2EDuration="5.093329056s" totalImagesPullingTime="2.679305911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:26.09165745 +0000 UTC m=+71.541367223" watchObservedRunningTime="2026-09-18 14:52:26.093329056 +0000 UTC m=+71.543038829" Sep 18 14:52:26.109592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.109534 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g2bgv" podStartSLOduration=67.463523705 podStartE2EDuration="1m10.109516461s" totalImagesPullingTime="2.645992756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:26.107257252 +0000 UTC m=+71.556967056" watchObservedRunningTime="2026-09-18 14:52:26.109516461 +0000 UTC m=+71.559226234" Sep 18 14:52:26.162131 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.162068 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mtwrk" podStartSLOduration=2.249946533 podStartE2EDuration="4.162047274s" totalImagesPullingTime="1.912100741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:26.161226639 +0000 UTC m=+71.610936410" watchObservedRunningTime="2026-09-18 14:52:26.162047274 +0000 UTC m=+71.611757045" Sep 18 14:52:26.222477 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.222434 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:26.323229 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:26.323149 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:26.927527 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:52:26.927497 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode343528a_e7f3_4b2b_9236_fc80988efc2a.slice/crio-49479626d5657956f41bb2dc93ca358d3c315bce958a387e5af58f2902724da3 WatchSource:0}: Error finding container 49479626d5657956f41bb2dc93ca358d3c315bce958a387e5af58f2902724da3: Status 404 returned error can't find the container with id 49479626d5657956f41bb2dc93ca358d3c315bce958a387e5af58f2902724da3 Sep 18 14:52:27.066062 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:27.066028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654d6dcf8-278mc" event={"ID":"e343528a-e7f3-4b2b-9236-fc80988efc2a","Type":"ContainerStarted","Data":"49479626d5657956f41bb2dc93ca358d3c315bce958a387e5af58f2902724da3"} Sep 18 14:52:27.074645 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:27.074623 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b847d7cbb-zrg7h" Sep 18 14:52:29.000768 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.000726 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:29.077500 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.077442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654d6dcf8-278mc" event={"ID":"e343528a-e7f3-4b2b-9236-fc80988efc2a","Type":"ContainerStarted","Data":"5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83"} Sep 18 14:52:29.079313 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.079287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qssc6" event={"ID":"c9dea73b-2e57-4248-928a-131e3d3756f2","Type":"ContainerStarted","Data":"3f42deb38cc697e4af67d61dcb09ca554b90a715d42110e16e2db0d1c85bd025"} Sep 18 14:52:29.081284 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.081261 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xcln" event={"ID":"e55b445e-9425-475c-8849-0eaa3e185ced","Type":"ContainerStarted","Data":"8dbc858c06f9172036e8832e082013884ce9d25610945ce1cab3bdf2bb3fc0b3"} Sep 18 14:52:29.081426 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.081396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:52:29.096745 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.096695 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-654d6dcf8-278mc" podStartSLOduration=4.096676755 podStartE2EDuration="4.096676755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:29.095547344 +0000 UTC m=+74.545257127" watchObservedRunningTime="2026-09-18 14:52:29.096676755 +0000 UTC m=+74.546386526" Sep 18 14:52:29.127569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.127525 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qssc6" podStartSLOduration=67.398668235 podStartE2EDuration="1m13.127509553s" totalImagesPullingTime="5.728841318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:29.111263821 +0000 UTC m=+74.560973594" watchObservedRunningTime="2026-09-18 14:52:29.127509553 +0000 UTC m=+74.577219316" Sep 18 14:52:29.127786 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.127768 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9xcln" podStartSLOduration=67.695563789 podStartE2EDuration="1m13.127763234s" totalImagesPullingTime="5.432199445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:29.126193303 +0000 UTC m=+74.575903096" watchObservedRunningTime="2026-09-18 14:52:29.127763234 +0000 UTC m=+74.577473003" Sep 18 14:52:29.577886 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.577851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:29.874615 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.874530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:29.935244 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:29.935210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:31.247671 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:31.247645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:31.349966 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:31.349935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:32.098704 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.098673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} Sep 18 14:52:32.098865 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.098730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} Sep 18 14:52:32.098865 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.098757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} Sep 18 14:52:32.098865 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.098781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} Sep 18 14:52:32.098865 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.098806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} Sep 18 14:52:32.098865 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.098828 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerStarted","Data":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} Sep 18 14:52:32.134283 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.134245 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:32.134479 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.134312 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.087990475 podStartE2EDuration="9.134292044s" totalImagesPullingTime="5.022116849s" totalInitContainerRuntime="24.18472ms" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:32.132269977 +0000 UTC m=+77.581979748" watchObservedRunningTime="2026-09-18 14:52:32.134292044 +0000 UTC m=+77.584001816" Sep 18 14:52:32.233504 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:32.233465 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:33.631835 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:33.631803 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:33.732590 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:33.732560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:34.074505 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:34.074462 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:52:35.782247 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:35.782215 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:35.782695 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:35.782271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:35.787074 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:35.787051 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:36.126338 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:36.126260 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:52:36.180183 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:36.180155 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cbbfbf47b-l2qms"] Sep 18 14:52:36.289177 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:36.289137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:36.389913 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:36.389832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:36.491773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:36.491738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:38.947403 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:38.947368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:39.005855 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:39.005818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:39.628972 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:39.628937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:42.113582 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:42.113552 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:42.113944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:42.113601 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:52:44.175094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:44.175057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:44.238639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:44.238613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:46.075319 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.075283 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65fcbcbb44-grr62" podUID="74041009-2df6-4edc-822e-629b9ce218cf" containerName="console" containerID="cri-o://be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349" gracePeriod=15 Sep 18 14:52:46.314685 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.314663 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:46.486831 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.486795 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-service-ca\") pod \"74041009-2df6-4edc-822e-629b9ce218cf\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " Sep 18 14:52:46.487005 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.486843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4hj8\" (UniqueName: \"kubernetes.io/projected/74041009-2df6-4edc-822e-629b9ce218cf-kube-api-access-q4hj8\") pod \"74041009-2df6-4edc-822e-629b9ce218cf\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " Sep 18 14:52:46.487005 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.486861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-oauth-serving-cert\") pod \"74041009-2df6-4edc-822e-629b9ce218cf\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " Sep 18 14:52:46.487005 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.486884 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-serving-cert\") pod \"74041009-2df6-4edc-822e-629b9ce218cf\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " Sep 18 14:52:46.487005 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.486911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-oauth-config\") pod \"74041009-2df6-4edc-822e-629b9ce218cf\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " Sep 18 14:52:46.487005 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.486929 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-console-config\") pod \"74041009-2df6-4edc-822e-629b9ce218cf\" (UID: \"74041009-2df6-4edc-822e-629b9ce218cf\") " Sep 18 14:52:46.487331 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.487301 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "74041009-2df6-4edc-822e-629b9ce218cf" (UID: "74041009-2df6-4edc-822e-629b9ce218cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:46.487435 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.487340 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74041009-2df6-4edc-822e-629b9ce218cf" (UID: "74041009-2df6-4edc-822e-629b9ce218cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:46.487435 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.487416 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-console-config" (OuterVolumeSpecName: "console-config") pod "74041009-2df6-4edc-822e-629b9ce218cf" (UID: "74041009-2df6-4edc-822e-629b9ce218cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:46.489275 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.489254 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74041009-2df6-4edc-822e-629b9ce218cf-kube-api-access-q4hj8" (OuterVolumeSpecName: "kube-api-access-q4hj8") pod "74041009-2df6-4edc-822e-629b9ce218cf" (UID: "74041009-2df6-4edc-822e-629b9ce218cf"). InnerVolumeSpecName "kube-api-access-q4hj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:46.489560 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.489531 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74041009-2df6-4edc-822e-629b9ce218cf" (UID: "74041009-2df6-4edc-822e-629b9ce218cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:52:46.489632 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.489606 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74041009-2df6-4edc-822e-629b9ce218cf" (UID: "74041009-2df6-4edc-822e-629b9ce218cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:52:46.588032 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.588008 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-service-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:52:46.588032 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.588031 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4hj8\" (UniqueName: \"kubernetes.io/projected/74041009-2df6-4edc-822e-629b9ce218cf-kube-api-access-q4hj8\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:52:46.588194 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.588041 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-oauth-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:52:46.588194 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.588050 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:52:46.588194 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.588063 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74041009-2df6-4edc-822e-629b9ce218cf-console-oauth-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:52:46.588194 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:46.588076 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74041009-2df6-4edc-822e-629b9ce218cf-console-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:52:47.165954 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.165922 2581 generic.go:356] "Generic (PLEG): container finished" podID="74041009-2df6-4edc-822e-629b9ce218cf" containerID="be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349" exitCode=0 Sep 18 14:52:47.166336 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.165969 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fcbcbb44-grr62" Sep 18 14:52:47.166336 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.166008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fcbcbb44-grr62" event={"ID":"74041009-2df6-4edc-822e-629b9ce218cf","Type":"ContainerDied","Data":"be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349"} Sep 18 14:52:47.166336 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.166054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fcbcbb44-grr62" event={"ID":"74041009-2df6-4edc-822e-629b9ce218cf","Type":"ContainerDied","Data":"6e8ec612520a0395c1e72becb4bafe5129a72d3e99a5a4045c2819131b671770"} Sep 18 14:52:47.166336 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.166075 2581 scope.go:117] "RemoveContainer" containerID="be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349" Sep 18 14:52:47.174920 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.174905 2581 scope.go:117] "RemoveContainer" containerID="be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349" Sep 18 14:52:47.175190 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:52:47.175170 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349\": container with ID starting with be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349 not found: ID does not exist" containerID="be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349" Sep 18 14:52:47.175241 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.175198 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349"} err="failed to get container status \"be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349\": rpc error: code = NotFound desc = could not find container \"be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349\": container with ID starting with be873d9b9240225d1b92b9cc64b048ebeaa1c4f08943f826d158a1c631f44349 not found: ID does not exist" Sep 18 14:52:47.181833 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.181812 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fcbcbb44-grr62"] Sep 18 14:52:47.187430 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:47.187411 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65fcbcbb44-grr62"] Sep 18 14:52:48.664518 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:48.664460 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74041009-2df6-4edc-822e-629b9ce218cf" path="/var/lib/kubelet/pods/74041009-2df6-4edc-822e-629b9ce218cf/volumes" Sep 18 14:52:50.016356 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:50.016289 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hgj6r_f13b930e-ba98-43ac-a9dd-daedaa617cc1/serve-healthcheck-canary/0.log" Sep 18 14:52:59.179450 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:59.179400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:59.243341 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:59.243310 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:52:59.318903 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:52:59.318874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:00.088995 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:00.088962 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9xcln" Sep 18 14:53:01.203251 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.203204 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cbbfbf47b-l2qms" podUID="c6bb90af-0d22-40a6-9624-a60f69938290" containerName="console" containerID="cri-o://f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2" gracePeriod=15 Sep 18 14:53:01.480454 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.480392 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:53:01.512178 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512150 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-service-ca\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512183 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-trusted-ca-bundle\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512229 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc8lr\" (UniqueName: \"kubernetes.io/projected/c6bb90af-0d22-40a6-9624-a60f69938290-kube-api-access-vc8lr\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512284 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-oauth-serving-cert\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512312 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-console-config\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512553 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512342 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-serving-cert\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512553 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512381 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-oauth-config\") pod \"c6bb90af-0d22-40a6-9624-a60f69938290\" (UID: \"c6bb90af-0d22-40a6-9624-a60f69938290\") " Sep 18 14:53:01.512553 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512514 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.512706 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512632 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-service-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.512765 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512695 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.512765 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512710 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.512868 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.512769 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-console-config" (OuterVolumeSpecName: "console-config") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:01.514710 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.514670 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:01.522100 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.522076 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6bb90af-0d22-40a6-9624-a60f69938290-kube-api-access-vc8lr" (OuterVolumeSpecName: "kube-api-access-vc8lr") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "kube-api-access-vc8lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:01.522160 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.522093 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6bb90af-0d22-40a6-9624-a60f69938290" (UID: "c6bb90af-0d22-40a6-9624-a60f69938290"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:01.613432 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.613401 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-trusted-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.613432 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.613428 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc8lr\" (UniqueName: \"kubernetes.io/projected/c6bb90af-0d22-40a6-9624-a60f69938290-kube-api-access-vc8lr\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.613432 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.613438 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-oauth-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.613662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.613447 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6bb90af-0d22-40a6-9624-a60f69938290-console-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.613662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.613456 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:01.613662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:01.613465 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6bb90af-0d22-40a6-9624-a60f69938290-console-oauth-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:02.125212 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.125183 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:53:02.129030 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.129004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55c8876dd7-jdqvn" Sep 18 14:53:02.236746 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.236717 2581 generic.go:356] "Generic (PLEG): container finished" podID="c6bb90af-0d22-40a6-9624-a60f69938290" containerID="f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2" exitCode=0 Sep 18 14:53:02.237161 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.236769 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbbfbf47b-l2qms" Sep 18 14:53:02.237161 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.236796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbbfbf47b-l2qms" event={"ID":"c6bb90af-0d22-40a6-9624-a60f69938290","Type":"ContainerDied","Data":"f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2"} Sep 18 14:53:02.237161 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.236846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbbfbf47b-l2qms" event={"ID":"c6bb90af-0d22-40a6-9624-a60f69938290","Type":"ContainerDied","Data":"7fe71675293d446f82bea5dcc5de553bf9ffcad980f1b36aadaea6a274331884"} Sep 18 14:53:02.237161 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.236868 2581 scope.go:117] "RemoveContainer" containerID="f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2" Sep 18 14:53:02.256306 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.256288 2581 scope.go:117] "RemoveContainer" containerID="f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2" Sep 18 14:53:02.256615 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:02.256596 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2\": container with ID starting with f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2 not found: ID does not exist" containerID="f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2" Sep 18 14:53:02.256674 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.256623 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2"} err="failed to get container status \"f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2\": rpc error: code = NotFound desc = could not find container \"f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2\": container with ID starting with f658f5dcd8e568f3778ce67a4957d349bdfb93fa23bb5e07951d283ae93935e2 not found: ID does not exist" Sep 18 14:53:02.261931 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.261907 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cbbfbf47b-l2qms"] Sep 18 14:53:02.267781 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.267736 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cbbfbf47b-l2qms"] Sep 18 14:53:02.663445 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:02.663415 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6bb90af-0d22-40a6-9624-a60f69938290" path="/var/lib/kubelet/pods/c6bb90af-0d22-40a6-9624-a60f69938290/volumes" Sep 18 14:53:06.693456 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:06.693422 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:06.793146 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:06.793112 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:06.893660 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:06.893623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:21.315284 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:21.315241 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:24.074853 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:24.074815 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:24.094677 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:24.094654 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:24.344367 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:24.344292 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:36.710264 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:36.710229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:36.824654 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:36.824619 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:37.730540 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.730503 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:53:37.730983 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.730857 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="alertmanager" containerID="cri-o://66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df" gracePeriod=120 Sep 18 14:53:37.730983 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.730913 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-metric" containerID="cri-o://1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d" gracePeriod=120 Sep 18 14:53:37.731093 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.730949 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="prom-label-proxy" containerID="cri-o://a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f" gracePeriod=120 Sep 18 14:53:37.731093 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.730980 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="config-reloader" containerID="cri-o://bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d" gracePeriod=120 Sep 18 14:53:37.731093 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.731008 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy" containerID="cri-o://5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58" gracePeriod=120 Sep 18 14:53:37.731093 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:37.730961 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-web" containerID="cri-o://f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271" gracePeriod=120 Sep 18 14:53:38.387455 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387423 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f" exitCode=0 Sep 18 14:53:38.387455 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387445 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58" exitCode=0 Sep 18 14:53:38.387455 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387451 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d" exitCode=0 Sep 18 14:53:38.387455 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387458 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df" exitCode=0 Sep 18 14:53:38.387785 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f"} Sep 18 14:53:38.387785 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58"} Sep 18 14:53:38.387785 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d"} Sep 18 14:53:38.387785 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.387694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df"} Sep 18 14:53:38.974356 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:38.974334 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.122616 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122538 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122616 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122616 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122604 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-metrics-client-ca\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122616 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122619 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-config-volume\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122736 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skl5k\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-kube-api-access-skl5k\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122776 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-config-out\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-main-db\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122846 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-cluster-tls-config\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.122928 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122919 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-web-config\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.123168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122960 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-web\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.123168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122962 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:39.123168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.122987 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-main-tls\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.123168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.123026 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-tls-assets\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.123168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.123051 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle\") pod \"53732f6b-b120-4320-a298-d0360baa2c81\" (UID: \"53732f6b-b120-4320-a298-d0360baa2c81\") " Sep 18 14:53:39.123391 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.123349 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-metrics-client-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.123538 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.123432 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:53:39.123993 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.123750 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:39.125805 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.125774 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.126178 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.126127 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.126294 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.126219 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-kube-api-access-skl5k" (OuterVolumeSpecName: "kube-api-access-skl5k") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "kube-api-access-skl5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:39.126363 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.126314 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-config-volume" (OuterVolumeSpecName: "config-volume") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.126536 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.126509 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:39.126929 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.126902 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.127130 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.127107 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.127389 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.127367 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-config-out" (OuterVolumeSpecName: "config-out") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:53:39.130382 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.130342 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.136768 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.136748 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-web-config" (OuterVolumeSpecName: "web-config") pod "53732f6b-b120-4320-a298-d0360baa2c81" (UID: "53732f6b-b120-4320-a298-d0360baa2c81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:39.223737 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223717 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.223822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223738 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.223822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223749 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-config-volume\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.223822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223758 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skl5k\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-kube-api-access-skl5k\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.223822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223774 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-config-out\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.223822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223782 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-main-db\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.223822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223803 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-cluster-tls-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.224013 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223827 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-web-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.224013 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223836 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.224013 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223845 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53732f6b-b120-4320-a298-d0360baa2c81-secret-alertmanager-main-tls\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.224013 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223852 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53732f6b-b120-4320-a298-d0360baa2c81-tls-assets\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.224013 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.223860 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53732f6b-b120-4320-a298-d0360baa2c81-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:39.394502 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394421 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d" exitCode=0 Sep 18 14:53:39.394502 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394442 2581 generic.go:356] "Generic (PLEG): container finished" podID="53732f6b-b120-4320-a298-d0360baa2c81" containerID="f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271" exitCode=0 Sep 18 14:53:39.394634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394518 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.394634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d"} Sep 18 14:53:39.394634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394601 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271"} Sep 18 14:53:39.394726 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53732f6b-b120-4320-a298-d0360baa2c81","Type":"ContainerDied","Data":"2865e2f62b01844fcf8823a6d04d974a938a3aaf7f12f624cf98cd27b167ca0d"} Sep 18 14:53:39.394726 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.394665 2581 scope.go:117] "RemoveContainer" containerID="a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f" Sep 18 14:53:39.402229 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.402207 2581 scope.go:117] "RemoveContainer" containerID="1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d" Sep 18 14:53:39.408918 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.408903 2581 scope.go:117] "RemoveContainer" containerID="5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58" Sep 18 14:53:39.415316 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.415295 2581 scope.go:117] "RemoveContainer" containerID="f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271" Sep 18 14:53:39.419431 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.419409 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:53:39.423407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.423380 2581 scope.go:117] "RemoveContainer" containerID="bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d" Sep 18 14:53:39.425391 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.425367 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:53:39.430034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.430018 2581 scope.go:117] "RemoveContainer" containerID="66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df" Sep 18 14:53:39.436689 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.436676 2581 scope.go:117] "RemoveContainer" containerID="b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0" Sep 18 14:53:39.443628 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.443611 2581 scope.go:117] "RemoveContainer" containerID="a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f" Sep 18 14:53:39.443906 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.443888 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f\": container with ID starting with a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f not found: ID does not exist" containerID="a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f" Sep 18 14:53:39.443956 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.443914 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f"} err="failed to get container status \"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f\": rpc error: code = NotFound desc = could not find container \"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f\": container with ID starting with a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f not found: ID does not exist" Sep 18 14:53:39.443956 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.443931 2581 scope.go:117] "RemoveContainer" containerID="1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d" Sep 18 14:53:39.444191 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.444175 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d\": container with ID starting with 1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d not found: ID does not exist" containerID="1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d" Sep 18 14:53:39.444236 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444196 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d"} err="failed to get container status \"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d\": rpc error: code = NotFound desc = could not find container \"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d\": container with ID starting with 1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d not found: ID does not exist" Sep 18 14:53:39.444236 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444209 2581 scope.go:117] "RemoveContainer" containerID="5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58" Sep 18 14:53:39.444443 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.444425 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58\": container with ID starting with 5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58 not found: ID does not exist" containerID="5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58" Sep 18 14:53:39.444526 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444450 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58"} err="failed to get container status \"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58\": rpc error: code = NotFound desc = could not find container \"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58\": container with ID starting with 5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58 not found: ID does not exist" Sep 18 14:53:39.444526 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444473 2581 scope.go:117] "RemoveContainer" containerID="f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271" Sep 18 14:53:39.444725 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.444710 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271\": container with ID starting with f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271 not found: ID does not exist" containerID="f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271" Sep 18 14:53:39.444763 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444731 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271"} err="failed to get container status \"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271\": rpc error: code = NotFound desc = could not find container \"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271\": container with ID starting with f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271 not found: ID does not exist" Sep 18 14:53:39.444763 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444744 2581 scope.go:117] "RemoveContainer" containerID="bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d" Sep 18 14:53:39.444985 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.444968 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d\": container with ID starting with bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d not found: ID does not exist" containerID="bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d" Sep 18 14:53:39.445045 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.444992 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d"} err="failed to get container status \"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d\": rpc error: code = NotFound desc = could not find container \"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d\": container with ID starting with bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d not found: ID does not exist" Sep 18 14:53:39.445045 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445014 2581 scope.go:117] "RemoveContainer" containerID="66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df" Sep 18 14:53:39.445256 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.445240 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df\": container with ID starting with 66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df not found: ID does not exist" containerID="66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df" Sep 18 14:53:39.445291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445260 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df"} err="failed to get container status \"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df\": rpc error: code = NotFound desc = could not find container \"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df\": container with ID starting with 66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df not found: ID does not exist" Sep 18 14:53:39.445291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445273 2581 scope.go:117] "RemoveContainer" containerID="b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0" Sep 18 14:53:39.445520 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:39.445482 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0\": container with ID starting with b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0 not found: ID does not exist" containerID="b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0" Sep 18 14:53:39.445569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445526 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0"} err="failed to get container status \"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0\": rpc error: code = NotFound desc = could not find container \"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0\": container with ID starting with b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0 not found: ID does not exist" Sep 18 14:53:39.445569 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445546 2581 scope.go:117] "RemoveContainer" containerID="a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f" Sep 18 14:53:39.445767 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445749 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f"} err="failed to get container status \"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f\": rpc error: code = NotFound desc = could not find container \"a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f\": container with ID starting with a3daf73b3c273c931ab9ea8ec8094884a8889c6e036861981b12cd9f4d6c3f0f not found: ID does not exist" Sep 18 14:53:39.445808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445767 2581 scope.go:117] "RemoveContainer" containerID="1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d" Sep 18 14:53:39.445984 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445965 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d"} err="failed to get container status \"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d\": rpc error: code = NotFound desc = could not find container \"1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d\": container with ID starting with 1b0f76970fd329dd99ee55befd32d9f0f09c3c71e67c33352616715892157d6d not found: ID does not exist" Sep 18 14:53:39.446026 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.445985 2581 scope.go:117] "RemoveContainer" containerID="5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58" Sep 18 14:53:39.446192 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446174 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58"} err="failed to get container status \"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58\": rpc error: code = NotFound desc = could not find container \"5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58\": container with ID starting with 5c12432c237c7c2075ddcf78069a99f4638a6f7018ce0b9dad7c826cd2f20a58 not found: ID does not exist" Sep 18 14:53:39.446233 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446192 2581 scope.go:117] "RemoveContainer" containerID="f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271" Sep 18 14:53:39.446402 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446388 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271"} err="failed to get container status \"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271\": rpc error: code = NotFound desc = could not find container \"f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271\": container with ID starting with f2ad9f01c29749b1c5602b99e007766f6d8242071ec0e5c11c39ed11f4762271 not found: ID does not exist" Sep 18 14:53:39.446455 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446402 2581 scope.go:117] "RemoveContainer" containerID="bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d" Sep 18 14:53:39.446633 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446615 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d"} err="failed to get container status \"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d\": rpc error: code = NotFound desc = could not find container \"bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d\": container with ID starting with bdebca2a785d1cc616143908fd155e4a46c660dd138210ae3212a9a07901f59d not found: ID does not exist" Sep 18 14:53:39.446689 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446633 2581 scope.go:117] "RemoveContainer" containerID="66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df" Sep 18 14:53:39.446836 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446817 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df"} err="failed to get container status \"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df\": rpc error: code = NotFound desc = could not find container \"66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df\": container with ID starting with 66cd80ea932a6afd3f22190a73e5202bee7e1c922d08c17f204151d3696c96df not found: ID does not exist" Sep 18 14:53:39.446902 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.446838 2581 scope.go:117] "RemoveContainer" containerID="b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0" Sep 18 14:53:39.447072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.447056 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0"} err="failed to get container status \"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0\": rpc error: code = NotFound desc = could not find container \"b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0\": container with ID starting with b582897e53f186dd1c7df9181c35aba57c9546446583aa5b8c4841f84889afe0 not found: ID does not exist" Sep 18 14:53:39.452674 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452656 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:53:39.452939 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452928 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy" Sep 18 14:53:39.452982 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452942 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy" Sep 18 14:53:39.452982 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452956 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74041009-2df6-4edc-822e-629b9ce218cf" containerName="console" Sep 18 14:53:39.452982 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452962 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="74041009-2df6-4edc-822e-629b9ce218cf" containerName="console" Sep 18 14:53:39.452982 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452976 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="alertmanager" Sep 18 14:53:39.452982 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452982 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="alertmanager" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452988 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="config-reloader" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452993 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="config-reloader" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.452999 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="prom-label-proxy" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453004 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="prom-label-proxy" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453011 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6bb90af-0d22-40a6-9624-a60f69938290" containerName="console" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453016 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6bb90af-0d22-40a6-9624-a60f69938290" containerName="console" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453024 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-web" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453029 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-web" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453035 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-metric" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453040 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-metric" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453048 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="init-config-reloader" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453053 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="init-config-reloader" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453095 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="config-reloader" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453102 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6bb90af-0d22-40a6-9624-a60f69938290" containerName="console" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453107 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-metric" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453112 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy-web" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453120 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="74041009-2df6-4edc-822e-629b9ce218cf" containerName="console" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453127 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="alertmanager" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453133 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="prom-label-proxy" Sep 18 14:53:39.453155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.453138 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53732f6b-b120-4320-a298-d0360baa2c81" containerName="kube-rbac-proxy" Sep 18 14:53:39.457924 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.457900 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460427 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460436 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460391 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-btb5w\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 14:53:39.460719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 14:53:39.461130 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.460849 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 14:53:39.466905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.466887 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 14:53:39.480518 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.480481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:53:39.627378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627477 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15596d4b-a02b-4b6b-a47c-181bf54fc53b-config-out\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627477 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15596d4b-a02b-4b6b-a47c-181bf54fc53b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627581 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-config-volume\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627581 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-web-config\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627581 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15596d4b-a02b-4b6b-a47c-181bf54fc53b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627671 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627671 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15596d4b-a02b-4b6b-a47c-181bf54fc53b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627671 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15596d4b-a02b-4b6b-a47c-181bf54fc53b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627671 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45b8x\" (UniqueName: \"kubernetes.io/projected/15596d4b-a02b-4b6b-a47c-181bf54fc53b-kube-api-access-45b8x\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.627820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.627762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.728855 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.728830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-config-volume\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.728855 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.728857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-web-config\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729025 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.728873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15596d4b-a02b-4b6b-a47c-181bf54fc53b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729025 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.728889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729025 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.728940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15596d4b-a02b-4b6b-a47c-181bf54fc53b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729025 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.728994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15596d4b-a02b-4b6b-a47c-181bf54fc53b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729232 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729232 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45b8x\" (UniqueName: \"kubernetes.io/projected/15596d4b-a02b-4b6b-a47c-181bf54fc53b-kube-api-access-45b8x\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729399 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15596d4b-a02b-4b6b-a47c-181bf54fc53b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729566 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729835 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729811 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15596d4b-a02b-4b6b-a47c-181bf54fc53b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729926 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729990 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.729990 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.729972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15596d4b-a02b-4b6b-a47c-181bf54fc53b-config-out\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.730101 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.730036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15596d4b-a02b-4b6b-a47c-181bf54fc53b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.730992 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.730961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15596d4b-a02b-4b6b-a47c-181bf54fc53b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.731573 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.731553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.731846 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.731820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-config-volume\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.732072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.732050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-web-config\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.732168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.732147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15596d4b-a02b-4b6b-a47c-181bf54fc53b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.732228 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.732172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.732804 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.732780 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.733196 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.733175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.733360 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.733343 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15596d4b-a02b-4b6b-a47c-181bf54fc53b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.733542 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.733526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15596d4b-a02b-4b6b-a47c-181bf54fc53b-config-out\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.737238 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.737220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45b8x\" (UniqueName: \"kubernetes.io/projected/15596d4b-a02b-4b6b-a47c-181bf54fc53b-kube-api-access-45b8x\") pod \"alertmanager-main-0\" (UID: \"15596d4b-a02b-4b6b-a47c-181bf54fc53b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:39.768037 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:39.768016 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 14:53:40.048060 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:40.048034 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 14:53:40.049864 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:53:40.049840 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15596d4b_a02b_4b6b_a47c_181bf54fc53b.slice/crio-0cd08d35c378cfb4e5dfaf74ccf567b19ae180a760159fe0d670d90acd5fe811 WatchSource:0}: Error finding container 0cd08d35c378cfb4e5dfaf74ccf567b19ae180a760159fe0d670d90acd5fe811: Status 404 returned error can't find the container with id 0cd08d35c378cfb4e5dfaf74ccf567b19ae180a760159fe0d670d90acd5fe811 Sep 18 14:53:40.401257 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:40.401177 2581 generic.go:356] "Generic (PLEG): container finished" podID="15596d4b-a02b-4b6b-a47c-181bf54fc53b" containerID="8e2bc8c443efadaa891c20b55f47449a4ebf1c02f52a5ce569a386aaa9bf5ef4" exitCode=0 Sep 18 14:53:40.401392 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:40.401266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerDied","Data":"8e2bc8c443efadaa891c20b55f47449a4ebf1c02f52a5ce569a386aaa9bf5ef4"} Sep 18 14:53:40.401392 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:40.401349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"0cd08d35c378cfb4e5dfaf74ccf567b19ae180a760159fe0d670d90acd5fe811"} Sep 18 14:53:40.661872 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:40.661845 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53732f6b-b120-4320-a298-d0360baa2c81" path="/var/lib/kubelet/pods/53732f6b-b120-4320-a298-d0360baa2c81/volumes" Sep 18 14:53:41.409940 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.409901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"530630fe1ef01041f8addbad6213c27de3df9aab403d246e5ef013c502ce92fb"} Sep 18 14:53:41.410337 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.409966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"297d73423a97a71567ff20f1c34022cc4ef7612b3f83a32edd480af0ccf99de7"} Sep 18 14:53:41.410337 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.409990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"2a10aba4ab3316cd928c178677e42fda72c8ee7a16307d716cc54ab193ab9371"} Sep 18 14:53:41.410337 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.410014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"8df82f95417d627b3193b93d0e8190d0e6883c6d11a33b0246835beb8cd9a2a9"} Sep 18 14:53:41.410337 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.410041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"62f3afeeb7563f048ffb8e3adf7685013b635a966a54aaaa90b8f04b9efe9218"} Sep 18 14:53:41.410337 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.410114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15596d4b-a02b-4b6b-a47c-181bf54fc53b","Type":"ContainerStarted","Data":"245af28325e47ccdcae46b7cb207531da71a92e3623b8f11fd2dfcb6a634957b"} Sep 18 14:53:41.438462 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.438415 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.424625222 podStartE2EDuration="2.438398932s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.77371ms" isStatefulPod=false podCreationTimestamp="2026-09-18 14:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:53:41.436231749 +0000 UTC m=+146.885941519" watchObservedRunningTime="2026-09-18 14:53:41.438398932 +0000 UTC m=+146.888108702" Sep 18 14:53:41.762721 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.762679 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86d6954f-rgmcb"] Sep 18 14:53:41.766627 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.766608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.768798 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.768781 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 14:53:41.768905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.768798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 14:53:41.768905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.768847 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 14:53:41.769034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.768981 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 14:53:41.769034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.768999 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vg62j\"" Sep 18 14:53:41.769145 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.769071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 14:53:41.774427 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.774410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 14:53:41.779131 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.779109 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86d6954f-rgmcb"] Sep 18 14:53:41.848422 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-federate-client-tls\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848596 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-serving-certs-ca-bundle\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848596 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf5m\" (UniqueName: \"kubernetes.io/projected/86e60f4a-d965-42d9-9785-da5aa92c8c30-kube-api-access-hlf5m\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848596 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-telemeter-client-tls\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-secret-telemeter-client\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.848696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.848688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-metrics-client-ca\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-secret-telemeter-client\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-metrics-client-ca\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-federate-client-tls\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-serving-certs-ca-bundle\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf5m\" (UniqueName: \"kubernetes.io/projected/86e60f4a-d965-42d9-9785-da5aa92c8c30-kube-api-access-hlf5m\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-telemeter-client-tls\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.949684 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.949683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.950302 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.950271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-metrics-client-ca\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.950437 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.950407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.950699 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.950673 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e60f4a-d965-42d9-9785-da5aa92c8c30-serving-certs-ca-bundle\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.952064 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.952037 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-secret-telemeter-client\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.952163 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.952082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.952304 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.952284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-federate-client-tls\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.952358 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.952284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86e60f4a-d965-42d9-9785-da5aa92c8c30-telemeter-client-tls\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:41.957780 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:41.957759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf5m\" (UniqueName: \"kubernetes.io/projected/86e60f4a-d965-42d9-9785-da5aa92c8c30-kube-api-access-hlf5m\") pod \"telemeter-client-86d6954f-rgmcb\" (UID: \"86e60f4a-d965-42d9-9785-da5aa92c8c30\") " pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:42.045894 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.045800 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:42.046658 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.046626 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="prometheus" containerID="cri-o://23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" gracePeriod=600 Sep 18 14:53:42.047239 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.047212 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" gracePeriod=600 Sep 18 14:53:42.047876 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.047630 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="config-reloader" containerID="cri-o://92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" gracePeriod=600 Sep 18 14:53:42.048542 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.047648 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="thanos-sidecar" containerID="cri-o://e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" gracePeriod=600 Sep 18 14:53:42.048908 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.047671 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy" containerID="cri-o://81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" gracePeriod=600 Sep 18 14:53:42.049047 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.047712 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-web" containerID="cri-o://6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" gracePeriod=600 Sep 18 14:53:42.077746 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.077718 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" Sep 18 14:53:42.315735 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.315708 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.355119 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-serving-certs-ca-bundle\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355119 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355114 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftn6b\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-kube-api-access-ftn6b\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355134 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-metrics-client-certs\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355155 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-tls\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355187 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-config\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355221 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-tls-assets\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355244 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-db\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355275 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-metrics-client-ca\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355300 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-kubelet-serving-ca-bundle\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355336 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355379 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-web-config\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355417 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-grpc-tls\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355441 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-trusted-ca-bundle\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355477 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-thanos-prometheus-http-client-file\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355550 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-kube-rbac-proxy\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355589 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-0\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355584 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.355905 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355611 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-2\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.356248 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355970 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.356248 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.356227 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.355644 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357016 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-1\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357054 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-config-out\") pod \"1fe79f74-7c93-4725-b1a7-78b324270dac\" (UID: \"1fe79f74-7c93-4725-b1a7-78b324270dac\") " Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357096 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357340 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357389 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357411 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-db\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357424 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-metrics-client-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.357657 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.357437 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.360143 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.360117 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.360291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.360141 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.360988 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.360959 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:53:42.361556 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.361474 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.361801 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.361770 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.362295 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.362261 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-config-out" (OuterVolumeSpecName: "config-out") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:53:42.362410 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.362385 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:42.362557 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.362532 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-config" (OuterVolumeSpecName: "config") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.362661 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.362643 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-kube-api-access-ftn6b" (OuterVolumeSpecName: "kube-api-access-ftn6b") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "kube-api-access-ftn6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:53:42.363060 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.362963 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.363060 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.363095 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.363430 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.363406 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.364179 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.364135 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.364758 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.364716 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.374792 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.374756 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-web-config" (OuterVolumeSpecName: "web-config") pod "1fe79f74-7c93-4725-b1a7-78b324270dac" (UID: "1fe79f74-7c93-4725-b1a7-78b324270dac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:53:42.387334 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.386990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86d6954f-rgmcb"] Sep 18 14:53:42.389277 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:53:42.389255 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e60f4a_d965_42d9_9785_da5aa92c8c30.slice/crio-5d8224cca941028e3e03513e9d63d7cfc16d1436077103a74f76bef027796086 WatchSource:0}: Error finding container 5d8224cca941028e3e03513e9d63d7cfc16d1436077103a74f76bef027796086: Status 404 returned error can't find the container with id 5d8224cca941028e3e03513e9d63d7cfc16d1436077103a74f76bef027796086 Sep 18 14:53:42.415324 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.415292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" event={"ID":"86e60f4a-d965-42d9-9785-da5aa92c8c30","Type":"ContainerStarted","Data":"5d8224cca941028e3e03513e9d63d7cfc16d1436077103a74f76bef027796086"} Sep 18 14:53:42.418870 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418844 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" exitCode=0 Sep 18 14:53:42.418870 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418871 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" exitCode=0 Sep 18 14:53:42.419010 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418881 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" exitCode=0 Sep 18 14:53:42.419010 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418888 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" exitCode=0 Sep 18 14:53:42.419010 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418893 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" exitCode=0 Sep 18 14:53:42.419010 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418899 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" exitCode=0 Sep 18 14:53:42.419010 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} Sep 18 14:53:42.419010 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.418951 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419047 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} Sep 18 14:53:42.419298 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.419295 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fe79f74-7c93-4725-b1a7-78b324270dac","Type":"ContainerDied","Data":"5f1a777ce1c5ebad907a6783acc582474ba0dbcc4583b79504162bcc5b97cf05"} Sep 18 14:53:42.427165 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.427107 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.434015 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.433999 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.443425 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.443402 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.444613 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.444583 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:42.446320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.446297 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:42.450776 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.450761 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.457414 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.457399 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.458250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458223 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458246 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-tls-assets\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458260 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458274 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-web-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458287 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-grpc-tls\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458299 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458315 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458329 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-kube-rbac-proxy\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458342 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458356 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458371 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458385 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1fe79f74-7c93-4725-b1a7-78b324270dac-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458394 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fe79f74-7c93-4725-b1a7-78b324270dac-config-out\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458398 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458402 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftn6b\" (UniqueName: \"kubernetes.io/projected/1fe79f74-7c93-4725-b1a7-78b324270dac-kube-api-access-ftn6b\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458414 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-metrics-client-certs\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.458773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.458426 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fe79f74-7c93-4725-b1a7-78b324270dac-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:53:42.464413 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.464393 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.470944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.470929 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.471212 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.471195 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.471278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.471223 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} err="failed to get container status \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" Sep 18 14:53:42.471278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.471248 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.471552 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.471533 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.471617 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.471557 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} err="failed to get container status \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" Sep 18 14:53:42.471617 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.471572 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.471809 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.471793 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.471852 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.471816 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} err="failed to get container status \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" Sep 18 14:53:42.471852 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.471833 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.472068 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.472050 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.472127 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472074 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} err="failed to get container status \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" Sep 18 14:53:42.472127 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472094 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.472333 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.472318 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.472370 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472337 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} err="failed to get container status \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" Sep 18 14:53:42.472370 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472355 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.472590 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.472573 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.472666 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472596 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} err="failed to get container status \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" Sep 18 14:53:42.472666 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472617 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.472846 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:53:42.472830 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.472881 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472850 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} err="failed to get container status \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" Sep 18 14:53:42.472881 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.472863 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.473093 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473076 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} err="failed to get container status \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" Sep 18 14:53:42.473152 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473094 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.473302 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473286 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} err="failed to get container status \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" Sep 18 14:53:42.473351 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473302 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.473515 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473482 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} err="failed to get container status \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" Sep 18 14:53:42.473587 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473517 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.473736 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473720 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} err="failed to get container status \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" Sep 18 14:53:42.473782 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473737 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.473925 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473908 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} err="failed to get container status \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" Sep 18 14:53:42.473984 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.473926 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.474130 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474115 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} err="failed to get container status \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" Sep 18 14:53:42.474172 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474131 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.474332 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474315 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} err="failed to get container status \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" Sep 18 14:53:42.474376 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474333 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.474570 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474553 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} err="failed to get container status \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" Sep 18 14:53:42.474619 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474572 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.474767 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474746 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} err="failed to get container status \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" Sep 18 14:53:42.474767 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474765 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.474979 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474964 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} err="failed to get container status \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" Sep 18 14:53:42.474979 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.474980 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.475212 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475196 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} err="failed to get container status \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" Sep 18 14:53:42.475259 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475214 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.475401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475383 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} err="failed to get container status \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" Sep 18 14:53:42.475469 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475403 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.475672 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475652 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} err="failed to get container status \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" Sep 18 14:53:42.475672 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475670 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.475882 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475864 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} err="failed to get container status \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" Sep 18 14:53:42.475957 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.475883 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.476170 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476152 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} err="failed to get container status \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" Sep 18 14:53:42.476209 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476171 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.476370 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476353 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} err="failed to get container status \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" Sep 18 14:53:42.476436 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476372 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.476627 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476607 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} err="failed to get container status \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" Sep 18 14:53:42.476677 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476627 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.476828 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476812 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} err="failed to get container status \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" Sep 18 14:53:42.476893 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.476830 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.477033 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477015 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} err="failed to get container status \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" Sep 18 14:53:42.477078 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477033 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.477241 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477225 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} err="failed to get container status \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" Sep 18 14:53:42.477307 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477242 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.477475 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477458 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} err="failed to get container status \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" Sep 18 14:53:42.477551 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477475 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.477734 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477710 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} err="failed to get container status \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" Sep 18 14:53:42.477734 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.477735 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.478049 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478023 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} err="failed to get container status \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" Sep 18 14:53:42.478154 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478050 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.478379 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478359 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} err="failed to get container status \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" Sep 18 14:53:42.478379 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478379 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.478751 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478664 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} err="failed to get container status \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" Sep 18 14:53:42.478751 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478687 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.478960 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478939 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} err="failed to get container status \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" Sep 18 14:53:42.479026 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.478962 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.479237 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479211 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} err="failed to get container status \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" Sep 18 14:53:42.479237 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479227 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.479451 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479435 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} err="failed to get container status \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" Sep 18 14:53:42.479560 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479452 2581 scope.go:117] "RemoveContainer" containerID="fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211" Sep 18 14:53:42.479734 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479719 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211"} err="failed to get container status \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": rpc error: code = NotFound desc = could not find container \"fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211\": container with ID starting with fc0e02fc4c948bbc8dd4f1e80e687933d8e1503a701a9527a84452781c406211 not found: ID does not exist" Sep 18 14:53:42.479795 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479734 2581 scope.go:117] "RemoveContainer" containerID="81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477" Sep 18 14:53:42.479965 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479944 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:42.480042 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.479949 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477"} err="failed to get container status \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": rpc error: code = NotFound desc = could not find container \"81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477\": container with ID starting with 81b1c0c1f69ec18193faedf407ad8b543bc1eb5490c71de7a490ee7709f4a477 not found: ID does not exist" Sep 18 14:53:42.480085 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480044 2581 scope.go:117] "RemoveContainer" containerID="6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9" Sep 18 14:53:42.480282 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480258 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9"} err="failed to get container status \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": rpc error: code = NotFound desc = could not find container \"6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9\": container with ID starting with 6356208d19f4a6c468497a0279872ae110c4f60573c863df8ceb5b7bc53125d9 not found: ID does not exist" Sep 18 14:53:42.480282 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480279 2581 scope.go:117] "RemoveContainer" containerID="e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480295 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="prometheus" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480307 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="prometheus" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480317 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="init-config-reloader" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480323 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="init-config-reloader" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480331 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="config-reloader" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480337 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="config-reloader" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480344 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480350 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480361 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-thanos" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480366 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-thanos" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480376 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="thanos-sidecar" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480384 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="thanos-sidecar" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480403 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-web" Sep 18 14:53:42.480434 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480410 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-web" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480465 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480477 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="config-reloader" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480483 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="thanos-sidecar" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480509 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="prometheus" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480510 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96"} err="failed to get container status \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": rpc error: code = NotFound desc = could not find container \"e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96\": container with ID starting with e5be8ce23b371f7baf2e5b2d56762d5d746ec799912f53f90c7fb81ebc100c96 not found: ID does not exist" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480527 2581 scope.go:117] "RemoveContainer" containerID="92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480518 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-web" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480557 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" containerName="kube-rbac-proxy-thanos" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480737 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c"} err="failed to get container status \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": rpc error: code = NotFound desc = could not find container \"92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c\": container with ID starting with 92045a15ded3b97f4bc594664e447142925312b92e00b17e1f17cf3476d0478c not found: ID does not exist" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480759 2581 scope.go:117] "RemoveContainer" containerID="23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480972 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463"} err="failed to get container status \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": rpc error: code = NotFound desc = could not find container \"23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463\": container with ID starting with 23f7f5d37f33efd3f917268fca2ce71bf52e973928976ba60e62f927f5839463 not found: ID does not exist" Sep 18 14:53:42.481057 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.480992 2581 scope.go:117] "RemoveContainer" containerID="f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7" Sep 18 14:53:42.481420 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.481235 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7"} err="failed to get container status \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": rpc error: code = NotFound desc = could not find container \"f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7\": container with ID starting with f8506a5a76ac27f1c9b6c8e647a5ae94a080e5d8a1e1588b958bdec8847c07e7 not found: ID does not exist" Sep 18 14:53:42.486105 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.486088 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.488289 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.488266 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 14:53:42.488583 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.488565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 14:53:42.488635 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.488571 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 14:53:42.488752 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.488737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 14:53:42.488846 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.488830 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 14:53:42.488912 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.488881 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 14:53:42.489138 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.489123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 14:53:42.489243 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.489228 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-63bnvudrg2ge9\"" Sep 18 14:53:42.489310 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.489241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 14:53:42.489310 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.489291 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 14:53:42.489503 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.489475 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 14:53:42.489777 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.489760 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 14:53:42.490128 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.490111 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xnkk4\"" Sep 18 14:53:42.490611 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.490584 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 14:53:42.492606 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.492587 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 14:53:42.494779 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.494761 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 14:53:42.500233 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.500214 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:42.559069 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559069 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559069 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559069 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2nlg\" (UniqueName: \"kubernetes.io/projected/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-kube-api-access-v2nlg\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559278 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559417 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559520 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.559662 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.559557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-config\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660104 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-config\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2nlg\" (UniqueName: \"kubernetes.io/projected/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-kube-api-access-v2nlg\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.660641 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.661149 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.661149 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.661149 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.660933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.661601 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.661551 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe79f74-7c93-4725-b1a7-78b324270dac" path="/var/lib/kubelet/pods/1fe79f74-7c93-4725-b1a7-78b324270dac/volumes" Sep 18 14:53:42.662837 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.662813 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.663317 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663297 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.663453 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-config\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.663902 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664004 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664093 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664176 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663815 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664255 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.663953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664334 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.664286 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664484 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.664403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.664942 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.664918 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.665062 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.665042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.665941 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.665922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.666003 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.665953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.666152 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.666135 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.666212 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.666148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.666319 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.666303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.672686 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.672670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2nlg\" (UniqueName: \"kubernetes.io/projected/a91fa0b8-9d68-42cb-bb73-3d81b24282fa-kube-api-access-v2nlg\") pod \"prometheus-k8s-0\" (UID: \"a91fa0b8-9d68-42cb-bb73-3d81b24282fa\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:42.796113 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:42.796090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:43.088892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:43.088860 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 14:53:43.425679 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:43.425647 2581 generic.go:356] "Generic (PLEG): container finished" podID="a91fa0b8-9d68-42cb-bb73-3d81b24282fa" containerID="b298db926b5141290711f102136d679cc991978043cafc50280161b52c6c1a1d" exitCode=0 Sep 18 14:53:43.426036 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:43.425730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerDied","Data":"b298db926b5141290711f102136d679cc991978043cafc50280161b52c6c1a1d"} Sep 18 14:53:43.426036 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:43.425797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"f1fc5bde4830c1c903b2ed2be9998580eefb1f5bf70a90092dab66b9485eee3f"} Sep 18 14:53:44.430991 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.430965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" event={"ID":"86e60f4a-d965-42d9-9785-da5aa92c8c30","Type":"ContainerStarted","Data":"8d619e579bd362defe37c2265d8b35c986e79e0d5bc2ff3822dd3d564e4a8fa5"} Sep 18 14:53:44.434714 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.434683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"66f69f6b2c6848ad17848c6444fccf8407627aa62279513f9a5081e4d6efd9cf"} Sep 18 14:53:44.434796 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.434749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"7b127a49009a80cee770522954776690b0fd9222b903da311cdd5445098b3c7f"} Sep 18 14:53:44.434796 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.434774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"a2e55387d828dbfed85321a29041c94a496bd1726a2cb216bd5ff78424748630"} Sep 18 14:53:44.434864 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.434798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"e35001a85406744739e2418a0d274090c0f29b425f6611928ec445f000092a02"} Sep 18 14:53:44.434864 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.434820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"49cc252db50ee560a431b32be1885bdd47e6351d23a6686b354263a22d63b5c6"} Sep 18 14:53:44.434864 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.434842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a91fa0b8-9d68-42cb-bb73-3d81b24282fa","Type":"ContainerStarted","Data":"d30f615414ce2dea9aa3c2827b48abc7acf97deb8fc017f82e1ea6eaebf0a2a4"} Sep 18 14:53:44.468762 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:44.468698 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.440430194 podStartE2EDuration="2.468675756s" totalImagesPullingTime="0s" totalInitContainerRuntime="28.245562ms" isStatefulPod=false podCreationTimestamp="2026-09-18 14:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:53:44.46653009 +0000 UTC m=+149.916239865" watchObservedRunningTime="2026-09-18 14:53:44.468675756 +0000 UTC m=+149.918385526" Sep 18 14:53:45.441640 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.441599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" event={"ID":"86e60f4a-d965-42d9-9785-da5aa92c8c30","Type":"ContainerStarted","Data":"cbc175ce68c103b02b8951ae5dbbea7445475abbea68960bf2bcd3d6867efe90"} Sep 18 14:53:45.442005 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.441671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" event={"ID":"86e60f4a-d965-42d9-9785-da5aa92c8c30","Type":"ContainerStarted","Data":"69f8c309f926cd520a79bccbfeaaaeeee9661afdebe17a1050392903979a74d1"} Sep 18 14:53:45.466357 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.466301 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86d6954f-rgmcb" podStartSLOduration=2.521438528 podStartE2EDuration="4.466281426s" totalImagesPullingTime="1.944842898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:53:45.464044187 +0000 UTC m=+150.913753955" watchObservedRunningTime="2026-09-18 14:53:45.466281426 +0000 UTC m=+150.915991197" Sep 18 14:53:45.564950 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.564921 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78b6979cd7-tcl84"] Sep 18 14:53:45.568221 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.568205 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.578540 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.578517 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b6979cd7-tcl84"] Sep 18 14:53:45.587744 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.587725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-oauth-config\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.587840 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.587749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-oauth-serving-cert\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.587840 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.587780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-service-ca\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.587840 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.587806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-serving-cert\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.588012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.587888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-console-config\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.588012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.587972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glx67\" (UniqueName: \"kubernetes.io/projected/0cb36891-49d1-4659-a287-9df5eaf97b54-kube-api-access-glx67\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.588012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.588004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-trusted-ca-bundle\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.625618 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.625595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.682279 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.682257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:45.689383 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-service-ca\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.689464 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-serving-cert\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.689464 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-console-config\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.689594 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glx67\" (UniqueName: \"kubernetes.io/projected/0cb36891-49d1-4659-a287-9df5eaf97b54-kube-api-access-glx67\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.689594 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-trusted-ca-bundle\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.689689 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-oauth-config\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.689689 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.689637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-oauth-serving-cert\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.690200 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.690175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-service-ca\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.690282 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.690189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-console-config\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.690353 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.690331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-oauth-serving-cert\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.690420 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.690402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-trusted-ca-bundle\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.692016 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.691968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-serving-cert\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.692016 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.691975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-oauth-config\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.697431 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.697416 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glx67\" (UniqueName: \"kubernetes.io/projected/0cb36891-49d1-4659-a287-9df5eaf97b54-kube-api-access-glx67\") pod \"console-78b6979cd7-tcl84\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:45.877241 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:45.877209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:46.175152 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:46.175024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b6979cd7-tcl84"] Sep 18 14:53:46.178509 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:53:46.178326 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb36891_49d1_4659_a287_9df5eaf97b54.slice/crio-34bd5efe5d771b25ee5fa7396d61548a0a224e6af64fcc039f3ceecc88440b55 WatchSource:0}: Error finding container 34bd5efe5d771b25ee5fa7396d61548a0a224e6af64fcc039f3ceecc88440b55: Status 404 returned error can't find the container with id 34bd5efe5d771b25ee5fa7396d61548a0a224e6af64fcc039f3ceecc88440b55 Sep 18 14:53:46.447866 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:46.447781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b6979cd7-tcl84" event={"ID":"0cb36891-49d1-4659-a287-9df5eaf97b54","Type":"ContainerStarted","Data":"27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259"} Sep 18 14:53:46.447866 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:46.447833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b6979cd7-tcl84" event={"ID":"0cb36891-49d1-4659-a287-9df5eaf97b54","Type":"ContainerStarted","Data":"34bd5efe5d771b25ee5fa7396d61548a0a224e6af64fcc039f3ceecc88440b55"} Sep 18 14:53:46.466075 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:46.466031 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78b6979cd7-tcl84" podStartSLOduration=1.4660163050000001 podStartE2EDuration="1.466016305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:53:46.46393492 +0000 UTC m=+151.913644693" watchObservedRunningTime="2026-09-18 14:53:46.466016305 +0000 UTC m=+151.915726075" Sep 18 14:53:47.796788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:47.796747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:53:55.877892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:55.877857 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:55.878293 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:55.877910 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:55.882409 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:55.882388 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:56.495004 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:56.494978 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:53:56.542704 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:56.542667 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654d6dcf8-278mc"] Sep 18 14:53:56.656058 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:56.656028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:56.754464 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:56.754383 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:53:56.854168 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:53:56.854143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:20.211721 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:20.211689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:20.312618 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:20.312590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:21.562425 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.562350 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-654d6dcf8-278mc" podUID="e343528a-e7f3-4b2b-9236-fc80988efc2a" containerName="console" containerID="cri-o://5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83" gracePeriod=15 Sep 18 14:54:21.805782 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.805754 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:54:21.878716 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878642 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-config\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.878716 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878672 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-trusted-ca-bundle\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.878716 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878689 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-oauth-config\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.878989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878730 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-service-ca\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.878989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878790 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78vnm\" (UniqueName: \"kubernetes.io/projected/e343528a-e7f3-4b2b-9236-fc80988efc2a-kube-api-access-78vnm\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.878989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-oauth-serving-cert\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.878989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.878855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-serving-cert\") pod \"e343528a-e7f3-4b2b-9236-fc80988efc2a\" (UID: \"e343528a-e7f3-4b2b-9236-fc80988efc2a\") " Sep 18 14:54:21.879216 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.879184 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-config" (OuterVolumeSpecName: "console-config") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.879290 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.879232 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.879359 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.879333 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.879407 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.879341 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:54:21.881132 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.881110 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:54:21.881428 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.881409 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e343528a-e7f3-4b2b-9236-fc80988efc2a-kube-api-access-78vnm" (OuterVolumeSpecName: "kube-api-access-78vnm") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "kube-api-access-78vnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:54:21.881480 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.881421 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e343528a-e7f3-4b2b-9236-fc80988efc2a" (UID: "e343528a-e7f3-4b2b-9236-fc80988efc2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:54:21.979604 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979571 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78vnm\" (UniqueName: \"kubernetes.io/projected/e343528a-e7f3-4b2b-9236-fc80988efc2a-kube-api-access-78vnm\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.979604 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979597 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-oauth-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.979604 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979609 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.979826 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979620 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.979826 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979633 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-trusted-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.979826 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979645 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e343528a-e7f3-4b2b-9236-fc80988efc2a-console-oauth-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:21.979826 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:21.979656 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e343528a-e7f3-4b2b-9236-fc80988efc2a-service-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:54:22.603614 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.603580 2581 generic.go:356] "Generic (PLEG): container finished" podID="e343528a-e7f3-4b2b-9236-fc80988efc2a" containerID="5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83" exitCode=0 Sep 18 14:54:22.603996 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.603630 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654d6dcf8-278mc" Sep 18 14:54:22.603996 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.603662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654d6dcf8-278mc" event={"ID":"e343528a-e7f3-4b2b-9236-fc80988efc2a","Type":"ContainerDied","Data":"5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83"} Sep 18 14:54:22.603996 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.603737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654d6dcf8-278mc" event={"ID":"e343528a-e7f3-4b2b-9236-fc80988efc2a","Type":"ContainerDied","Data":"49479626d5657956f41bb2dc93ca358d3c315bce958a387e5af58f2902724da3"} Sep 18 14:54:22.603996 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.603757 2581 scope.go:117] "RemoveContainer" containerID="5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83" Sep 18 14:54:22.615506 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.615481 2581 scope.go:117] "RemoveContainer" containerID="5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83" Sep 18 14:54:22.615766 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:54:22.615751 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83\": container with ID starting with 5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83 not found: ID does not exist" containerID="5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83" Sep 18 14:54:22.615828 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.615780 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83"} err="failed to get container status \"5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83\": rpc error: code = NotFound desc = could not find container \"5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83\": container with ID starting with 5df5ad66e948203668f4db7b8336b09a1aa8ce35c56eaaf0c09724e8db764c83 not found: ID does not exist" Sep 18 14:54:22.627299 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.627276 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654d6dcf8-278mc"] Sep 18 14:54:22.631820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.631801 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-654d6dcf8-278mc"] Sep 18 14:54:22.661261 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:22.661236 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e343528a-e7f3-4b2b-9236-fc80988efc2a" path="/var/lib/kubelet/pods/e343528a-e7f3-4b2b-9236-fc80988efc2a/volumes" Sep 18 14:54:42.796686 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:42.796655 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:54:42.812225 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:42.812198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:54:43.707760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:43.707737 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 14:54:51.916273 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:51.916236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:51.971592 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:51.971563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:55.335260 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.335226 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766cb768bf-5hqd9"] Sep 18 14:54:55.335619 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.335568 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e343528a-e7f3-4b2b-9236-fc80988efc2a" containerName="console" Sep 18 14:54:55.335619 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.335580 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e343528a-e7f3-4b2b-9236-fc80988efc2a" containerName="console" Sep 18 14:54:55.335689 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.335634 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e343528a-e7f3-4b2b-9236-fc80988efc2a" containerName="console" Sep 18 14:54:55.340139 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.340120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.352769 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.352747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766cb768bf-5hqd9"] Sep 18 14:54:55.425974 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.425941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:54:55.458760 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-oauth-serving-cert\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.458878 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-oauth-config\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.458878 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-service-ca\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.458878 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-serving-cert\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.458878 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-trusted-ca-bundle\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.459033 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-config\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.459033 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.458949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzrq\" (UniqueName: \"kubernetes.io/projected/e009e8d4-4b08-40dd-a21f-676d8926de8c-kube-api-access-5tzrq\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560017 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.559984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-oauth-config\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560017 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-service-ca\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560208 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-serving-cert\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560208 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-trusted-ca-bundle\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560208 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-config\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560401 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzrq\" (UniqueName: \"kubernetes.io/projected/e009e8d4-4b08-40dd-a21f-676d8926de8c-kube-api-access-5tzrq\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560508 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-oauth-serving-cert\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.560947 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.560917 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-config\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.561040 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.561014 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-service-ca\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.561128 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.561103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-trusted-ca-bundle\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.561243 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.561218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-oauth-serving-cert\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.562586 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.562571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-serving-cert\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.562711 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.562696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-oauth-config\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.569448 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.569429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzrq\" (UniqueName: \"kubernetes.io/projected/e009e8d4-4b08-40dd-a21f-676d8926de8c-kube-api-access-5tzrq\") pod \"console-766cb768bf-5hqd9\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.649102 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.649028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:54:55.919173 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:55.919144 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766cb768bf-5hqd9"] Sep 18 14:54:55.921732 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:54:55.921708 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode009e8d4_4b08_40dd_a21f_676d8926de8c.slice/crio-b5d4b5c0e19bcce9f3390338ab23cb841f9531c839a94280a8d0dbc3fb4460b6 WatchSource:0}: Error finding container b5d4b5c0e19bcce9f3390338ab23cb841f9531c839a94280a8d0dbc3fb4460b6: Status 404 returned error can't find the container with id b5d4b5c0e19bcce9f3390338ab23cb841f9531c839a94280a8d0dbc3fb4460b6 Sep 18 14:54:56.744682 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:56.744644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766cb768bf-5hqd9" event={"ID":"e009e8d4-4b08-40dd-a21f-676d8926de8c","Type":"ContainerStarted","Data":"595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185"} Sep 18 14:54:56.745073 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:56.744700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766cb768bf-5hqd9" event={"ID":"e009e8d4-4b08-40dd-a21f-676d8926de8c","Type":"ContainerStarted","Data":"b5d4b5c0e19bcce9f3390338ab23cb841f9531c839a94280a8d0dbc3fb4460b6"} Sep 18 14:54:56.763796 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:54:56.763742 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766cb768bf-5hqd9" podStartSLOduration=1.7637242290000001 podStartE2EDuration="1.763724229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:54:56.761990246 +0000 UTC m=+222.211700009" watchObservedRunningTime="2026-09-18 14:54:56.763724229 +0000 UTC m=+222.213434000" Sep 18 14:55:03.868247 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:03.868214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:03.922047 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:03.922021 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:05.649959 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:05.649923 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:55:05.650364 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:05.650024 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:55:05.654582 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:05.654559 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:55:05.786863 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:05.786838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:55:05.844350 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:05.844317 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b6979cd7-tcl84"] Sep 18 14:55:05.980238 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:05.980211 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:06.083251 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:06.083219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:06.145795 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:06.145762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:11.479403 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:11.479373 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:11.580450 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:11.580414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:55:30.864072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:30.863975 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78b6979cd7-tcl84" podUID="0cb36891-49d1-4659-a287-9df5eaf97b54" containerName="console" containerID="cri-o://27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259" gracePeriod=15 Sep 18 14:55:31.099255 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.099232 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:55:31.161089 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161027 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-serving-cert\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161089 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161085 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-oauth-serving-cert\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161287 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161110 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-oauth-config\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161287 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161230 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-service-ca\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161391 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161306 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-console-config\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161391 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161352 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glx67\" (UniqueName: \"kubernetes.io/projected/0cb36891-49d1-4659-a287-9df5eaf97b54-kube-api-access-glx67\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161508 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161396 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-trusted-ca-bundle\") pod \"0cb36891-49d1-4659-a287-9df5eaf97b54\" (UID: \"0cb36891-49d1-4659-a287-9df5eaf97b54\") " Sep 18 14:55:31.161563 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161536 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:55:31.161690 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161661 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-service-ca" (OuterVolumeSpecName: "service-ca") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:55:31.161752 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161717 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-oauth-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.161799 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161748 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-console-config" (OuterVolumeSpecName: "console-config") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:55:31.161959 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.161933 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:55:31.163270 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.163245 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:55:31.163384 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.163361 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:55:31.163384 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.163369 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cb36891-49d1-4659-a287-9df5eaf97b54-kube-api-access-glx67" (OuterVolumeSpecName: "kube-api-access-glx67") pod "0cb36891-49d1-4659-a287-9df5eaf97b54" (UID: "0cb36891-49d1-4659-a287-9df5eaf97b54"). InnerVolumeSpecName "kube-api-access-glx67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:55:31.262292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.262265 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-oauth-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.262292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.262288 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-service-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.262292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.262298 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-console-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.262512 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.262308 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glx67\" (UniqueName: \"kubernetes.io/projected/0cb36891-49d1-4659-a287-9df5eaf97b54-kube-api-access-glx67\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.262512 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.262316 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb36891-49d1-4659-a287-9df5eaf97b54-trusted-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.262512 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.262324 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cb36891-49d1-4659-a287-9df5eaf97b54-console-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:55:31.890296 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.890263 2581 generic.go:356] "Generic (PLEG): container finished" podID="0cb36891-49d1-4659-a287-9df5eaf97b54" containerID="27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259" exitCode=0 Sep 18 14:55:31.890707 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.890307 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b6979cd7-tcl84" Sep 18 14:55:31.890707 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.890346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b6979cd7-tcl84" event={"ID":"0cb36891-49d1-4659-a287-9df5eaf97b54","Type":"ContainerDied","Data":"27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259"} Sep 18 14:55:31.890707 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.890399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b6979cd7-tcl84" event={"ID":"0cb36891-49d1-4659-a287-9df5eaf97b54","Type":"ContainerDied","Data":"34bd5efe5d771b25ee5fa7396d61548a0a224e6af64fcc039f3ceecc88440b55"} Sep 18 14:55:31.890707 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.890421 2581 scope.go:117] "RemoveContainer" containerID="27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259" Sep 18 14:55:31.898961 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.898946 2581 scope.go:117] "RemoveContainer" containerID="27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259" Sep 18 14:55:31.899238 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:55:31.899221 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259\": container with ID starting with 27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259 not found: ID does not exist" containerID="27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259" Sep 18 14:55:31.899287 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.899248 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259"} err="failed to get container status \"27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259\": rpc error: code = NotFound desc = could not find container \"27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259\": container with ID starting with 27c1983a6dee6e9e7914468c914aeab538ff0611f09d4076318e7b832443f259 not found: ID does not exist" Sep 18 14:55:31.912262 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.912239 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b6979cd7-tcl84"] Sep 18 14:55:31.916354 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:31.916334 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78b6979cd7-tcl84"] Sep 18 14:55:32.662121 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:32.662094 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cb36891-49d1-4659-a287-9df5eaf97b54" path="/var/lib/kubelet/pods/0cb36891-49d1-4659-a287-9df5eaf97b54/volumes" Sep 18 14:55:41.228408 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:55:41.228372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:01.019341 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:01.019308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:02.441138 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:02.441107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:16.556622 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:16.556593 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 14:56:16.560537 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:16.560519 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 14:56:16.561640 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:16.561623 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 14:56:23.217445 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:23.217407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:24.574942 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:24.574888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:26.831922 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:26.831894 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:26.938316 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:26.938285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:29.068077 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:29.068046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:29.167207 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:29.167181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:29.358702 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:29.358637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:29.527270 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:29.527244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:31.234223 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.234190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:31.680427 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.680396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:31.901910 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.901878 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-thc4z"] Sep 18 14:56:31.902229 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.902218 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb36891-49d1-4659-a287-9df5eaf97b54" containerName="console" Sep 18 14:56:31.902271 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.902231 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb36891-49d1-4659-a287-9df5eaf97b54" containerName="console" Sep 18 14:56:31.902305 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.902296 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb36891-49d1-4659-a287-9df5eaf97b54" containerName="console" Sep 18 14:56:31.905157 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.905143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:31.907656 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.907637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6wkck\"" Sep 18 14:56:31.907759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.907680 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 14:56:31.907759 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.907743 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 14:56:31.914891 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.914871 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-thc4z"] Sep 18 14:56:31.931750 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.931697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94jx7\" (UniqueName: \"kubernetes.io/projected/69fbb48f-592b-42eb-aa5b-bc001630bdae-kube-api-access-94jx7\") pod \"cert-manager-cainjector-559cdd8c87-thc4z\" (UID: \"69fbb48f-592b-42eb-aa5b-bc001630bdae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:31.931750 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:31.931736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69fbb48f-592b-42eb-aa5b-bc001630bdae-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-thc4z\" (UID: \"69fbb48f-592b-42eb-aa5b-bc001630bdae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:32.032844 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.032819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94jx7\" (UniqueName: \"kubernetes.io/projected/69fbb48f-592b-42eb-aa5b-bc001630bdae-kube-api-access-94jx7\") pod \"cert-manager-cainjector-559cdd8c87-thc4z\" (UID: \"69fbb48f-592b-42eb-aa5b-bc001630bdae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:32.032930 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.032847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69fbb48f-592b-42eb-aa5b-bc001630bdae-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-thc4z\" (UID: \"69fbb48f-592b-42eb-aa5b-bc001630bdae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:32.041833 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.041806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94jx7\" (UniqueName: \"kubernetes.io/projected/69fbb48f-592b-42eb-aa5b-bc001630bdae-kube-api-access-94jx7\") pod \"cert-manager-cainjector-559cdd8c87-thc4z\" (UID: \"69fbb48f-592b-42eb-aa5b-bc001630bdae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:32.042028 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.042011 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69fbb48f-592b-42eb-aa5b-bc001630bdae-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-thc4z\" (UID: \"69fbb48f-592b-42eb-aa5b-bc001630bdae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:32.225884 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.225807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" Sep 18 14:56:32.494326 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.494300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-thc4z"] Sep 18 14:56:32.496440 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:56:32.496412 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69fbb48f_592b_42eb_aa5b_bc001630bdae.slice/crio-35fdf9653f8f23141a164ab36de627b9f8ad58f0be22477b561002abc8a26db0 WatchSource:0}: Error finding container 35fdf9653f8f23141a164ab36de627b9f8ad58f0be22477b561002abc8a26db0: Status 404 returned error can't find the container with id 35fdf9653f8f23141a164ab36de627b9f8ad58f0be22477b561002abc8a26db0 Sep 18 14:56:32.498733 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:32.498718 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 14:56:33.137054 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:33.136993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" event={"ID":"69fbb48f-592b-42eb-aa5b-bc001630bdae","Type":"ContainerStarted","Data":"35fdf9653f8f23141a164ab36de627b9f8ad58f0be22477b561002abc8a26db0"} Sep 18 14:56:33.818462 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:33.818424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:33.917023 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:33.916987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:36.153165 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:36.153130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" event={"ID":"69fbb48f-592b-42eb-aa5b-bc001630bdae","Type":"ContainerStarted","Data":"40f68a34fd042d8a3d125dc962adaf12e53e475f8f1a6c16b8247517ad6f9bd0"} Sep 18 14:56:36.172749 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:36.172702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-thc4z" podStartSLOduration=2.17926921 podStartE2EDuration="5.172685771s" totalImagesPullingTime="2.993416561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:56:36.171989481 +0000 UTC m=+321.621699253" watchObservedRunningTime="2026-09-18 14:56:36.172685771 +0000 UTC m=+321.622395542" Sep 18 14:56:39.259259 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:39.259227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:45.215095 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:45.215059 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:45.319840 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:45.319812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:47.241585 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.241533 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf"] Sep 18 14:56:47.244823 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.244807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.247607 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.247584 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 18 14:56:47.247710 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.247614 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-59jtr\"" Sep 18 14:56:47.247710 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.247637 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:56:47.255147 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.255127 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf"] Sep 18 14:56:47.355997 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.355965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/155ff73a-3230-475c-a16f-ca71e194e9a1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gdqsf\" (UID: \"155ff73a-3230-475c-a16f-ca71e194e9a1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.356146 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.356007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb7hz\" (UniqueName: \"kubernetes.io/projected/155ff73a-3230-475c-a16f-ca71e194e9a1-kube-api-access-bb7hz\") pod \"openshift-lws-operator-fd8ccff4c-gdqsf\" (UID: \"155ff73a-3230-475c-a16f-ca71e194e9a1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.456381 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.456357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/155ff73a-3230-475c-a16f-ca71e194e9a1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gdqsf\" (UID: \"155ff73a-3230-475c-a16f-ca71e194e9a1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.456505 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.456391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb7hz\" (UniqueName: \"kubernetes.io/projected/155ff73a-3230-475c-a16f-ca71e194e9a1-kube-api-access-bb7hz\") pod \"openshift-lws-operator-fd8ccff4c-gdqsf\" (UID: \"155ff73a-3230-475c-a16f-ca71e194e9a1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.456778 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.456759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/155ff73a-3230-475c-a16f-ca71e194e9a1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gdqsf\" (UID: \"155ff73a-3230-475c-a16f-ca71e194e9a1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.464839 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.464818 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb7hz\" (UniqueName: \"kubernetes.io/projected/155ff73a-3230-475c-a16f-ca71e194e9a1-kube-api-access-bb7hz\") pod \"openshift-lws-operator-fd8ccff4c-gdqsf\" (UID: \"155ff73a-3230-475c-a16f-ca71e194e9a1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.554547 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.554471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" Sep 18 14:56:47.826190 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:47.826018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf"] Sep 18 14:56:47.828504 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:56:47.828463 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod155ff73a_3230_475c_a16f_ca71e194e9a1.slice/crio-05919d4360f57e54484839f1ae4dcc5507bb3550f78fa7f656f7952d9e35250f WatchSource:0}: Error finding container 05919d4360f57e54484839f1ae4dcc5507bb3550f78fa7f656f7952d9e35250f: Status 404 returned error can't find the container with id 05919d4360f57e54484839f1ae4dcc5507bb3550f78fa7f656f7952d9e35250f Sep 18 14:56:48.201946 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:48.201912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" event={"ID":"155ff73a-3230-475c-a16f-ca71e194e9a1","Type":"ContainerStarted","Data":"05919d4360f57e54484839f1ae4dcc5507bb3550f78fa7f656f7952d9e35250f"} Sep 18 14:56:51.217438 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:51.217408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" event={"ID":"155ff73a-3230-475c-a16f-ca71e194e9a1","Type":"ContainerStarted","Data":"143eed359a474d7be5012adaa936e8f339aae0b816be0494f1c7ded751791ed3"} Sep 18 14:56:51.240570 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:51.240523 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gdqsf" podStartSLOduration=1.789676901 podStartE2EDuration="4.240507828s" totalImagesPullingTime="2.450830927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:56:51.238879165 +0000 UTC m=+336.688588934" watchObservedRunningTime="2026-09-18 14:56:51.240507828 +0000 UTC m=+336.690217588" Sep 18 14:56:52.002455 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:52.002415 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:52.103293 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:52.103265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:54.019591 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:54.019559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:54.593383 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:54.593350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:56:54.693640 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:56:54.693610 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:04.303577 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.303500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:04.355994 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.355963 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5"] Sep 18 14:57:04.359249 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.359231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.362847 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.362821 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rdcc8\"" Sep 18 14:57:04.362956 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.362860 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 18 14:57:04.362956 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.362822 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 18 14:57:04.362956 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.362941 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 18 14:57:04.372099 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.372081 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5"] Sep 18 14:57:04.396053 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.396028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:04.498788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.498754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-metrics-cert\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.498920 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.498851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-manager-config\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.498920 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.498892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqrk\" (UniqueName: \"kubernetes.io/projected/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-kube-api-access-nwqrk\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.499017 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.498928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-cert\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.599867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.599798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-metrics-cert\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.599867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.599836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-manager-config\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.599867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.599854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqrk\" (UniqueName: \"kubernetes.io/projected/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-kube-api-access-nwqrk\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.600126 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.599873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-cert\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.600563 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.600539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-manager-config\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.602197 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.602178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-cert\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.602280 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.602229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-metrics-cert\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.608483 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.608461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqrk\" (UniqueName: \"kubernetes.io/projected/daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414-kube-api-access-nwqrk\") pod \"lws-controller-manager-859bf4c848-8dzt5\" (UID: \"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.667935 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.667908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:04.948871 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:04.948846 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5"] Sep 18 14:57:04.951001 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:57:04.950971 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa08df8_37c7_4b8f_9ea4_c7cc9f5ee414.slice/crio-fb4b598c55d4bf777fd5d6adbbb193c7801e346bd24f497f99139a6f1247fec1 WatchSource:0}: Error finding container fb4b598c55d4bf777fd5d6adbbb193c7801e346bd24f497f99139a6f1247fec1: Status 404 returned error can't find the container with id fb4b598c55d4bf777fd5d6adbbb193c7801e346bd24f497f99139a6f1247fec1 Sep 18 14:57:05.278366 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:05.278290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" event={"ID":"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414","Type":"ContainerStarted","Data":"fb4b598c55d4bf777fd5d6adbbb193c7801e346bd24f497f99139a6f1247fec1"} Sep 18 14:57:07.291688 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:07.291654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" event={"ID":"daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414","Type":"ContainerStarted","Data":"622bc024f1b901e71ba39f2a3bd75f6c86ef170f3987485a89efdeb4285116ef"} Sep 18 14:57:07.292065 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:07.291768 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:07.330925 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:07.330879 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" podStartSLOduration=1.8991787850000001 podStartE2EDuration="3.330863084s" totalImagesPullingTime="1.431684299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:07.326682549 +0000 UTC m=+352.776392319" watchObservedRunningTime="2026-09-18 14:57:07.330863084 +0000 UTC m=+352.780572854" Sep 18 14:57:07.613045 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:07.612975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:07.713793 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:07.713760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:07.953708 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:07.953673 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:08.272696 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.272626 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:08.376770 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.376739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:08.437241 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.437213 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn"] Sep 18 14:57:08.478020 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.477993 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn"] Sep 18 14:57:08.478151 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.478085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.481648 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.481622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 14:57:08.481648 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.481658 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j9ltq\"" Sep 18 14:57:08.481648 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.481664 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 14:57:08.481648 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.481674 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 14:57:08.481968 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.481952 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 14:57:08.584878 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.584796 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:08.636377 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.636352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb91f711-40a5-4655-8997-0409a484bbe5-manifests\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.636525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.636390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb91f711-40a5-4655-8997-0409a484bbe5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.636525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.636414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnftq\" (UniqueName: \"kubernetes.io/projected/eb91f711-40a5-4655-8997-0409a484bbe5-kube-api-access-jnftq\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.636525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.636433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb91f711-40a5-4655-8997-0409a484bbe5-tmp\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.636525 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.636447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb91f711-40a5-4655-8997-0409a484bbe5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.683357 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.683334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:08.737058 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.737032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb91f711-40a5-4655-8997-0409a484bbe5-manifests\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.737194 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.737079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb91f711-40a5-4655-8997-0409a484bbe5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.737267 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.737225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnftq\" (UniqueName: \"kubernetes.io/projected/eb91f711-40a5-4655-8997-0409a484bbe5-kube-api-access-jnftq\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.737328 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.737267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb91f711-40a5-4655-8997-0409a484bbe5-tmp\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.737328 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.737298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb91f711-40a5-4655-8997-0409a484bbe5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.737432 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.737404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb91f711-40a5-4655-8997-0409a484bbe5-manifests\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.739332 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.739306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb91f711-40a5-4655-8997-0409a484bbe5-tmp\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.739451 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.739354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb91f711-40a5-4655-8997-0409a484bbe5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.739541 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.739514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb91f711-40a5-4655-8997-0409a484bbe5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.744862 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.744840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnftq\" (UniqueName: \"kubernetes.io/projected/eb91f711-40a5-4655-8997-0409a484bbe5-kube-api-access-jnftq\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn\" (UID: \"eb91f711-40a5-4655-8997-0409a484bbe5\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.782598 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.782571 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:08.788555 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.788532 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:08.898268 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:08.898239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:09.005049 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:09.005000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:09.088418 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:09.088397 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn"] Sep 18 14:57:09.090392 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:57:09.090366 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb91f711_40a5_4655_8997_0409a484bbe5.slice/crio-e367e66e699a26bb524eee546c233863c690374c242170e1123dab46dd9520d4 WatchSource:0}: Error finding container e367e66e699a26bb524eee546c233863c690374c242170e1123dab46dd9520d4: Status 404 returned error can't find the container with id e367e66e699a26bb524eee546c233863c690374c242170e1123dab46dd9520d4 Sep 18 14:57:09.091043 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:09.091017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:09.301540 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:09.301508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" event={"ID":"eb91f711-40a5-4655-8997-0409a484bbe5","Type":"ContainerStarted","Data":"e367e66e699a26bb524eee546c233863c690374c242170e1123dab46dd9520d4"} Sep 18 14:57:12.318984 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:12.318912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" event={"ID":"eb91f711-40a5-4655-8997-0409a484bbe5","Type":"ContainerStarted","Data":"3293948892bea4702d6d9aa0e5f57c38394590d6df9d88c9f522be9571af6b69"} Sep 18 14:57:13.324570 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:13.324538 2581 generic.go:356] "Generic (PLEG): container finished" podID="eb91f711-40a5-4655-8997-0409a484bbe5" containerID="3293948892bea4702d6d9aa0e5f57c38394590d6df9d88c9f522be9571af6b69" exitCode=0 Sep 18 14:57:13.324906 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:13.324589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" event={"ID":"eb91f711-40a5-4655-8997-0409a484bbe5","Type":"ContainerDied","Data":"3293948892bea4702d6d9aa0e5f57c38394590d6df9d88c9f522be9571af6b69"} Sep 18 14:57:14.333813 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:14.333777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" event={"ID":"eb91f711-40a5-4655-8997-0409a484bbe5","Type":"ContainerStarted","Data":"ac4fd883320636fefb890cfb66df9e9dba536812d1b382ecc5da4f48851de017"} Sep 18 14:57:14.334271 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:14.333848 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:14.396043 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:14.396000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" podStartSLOduration=2.130911707 podStartE2EDuration="6.395985152s" totalImagesPullingTime="3.199711094s" totalInitContainerRuntime="1.065362351s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:14.392807488 +0000 UTC m=+359.842517258" watchObservedRunningTime="2026-09-18 14:57:14.395985152 +0000 UTC m=+359.845694922" Sep 18 14:57:18.298860 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:18.298824 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-8dzt5" Sep 18 14:57:19.460333 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:19.460295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:19.556287 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:19.556253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:19.676247 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:19.676214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:19.783257 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:19.783182 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:20.115913 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:20.115834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:20.216410 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:20.216382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:20.510796 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:20.510766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:20.610258 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:20.610222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:24.800556 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.800526 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c85466689-9964l"] Sep 18 14:57:24.807059 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.807040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.817879 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.817854 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c85466689-9964l"] Sep 18 14:57:24.869440 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.869409 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:24.872660 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f773fb6-69e4-4013-88d7-1842bbd37336-console-oauth-config\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.872790 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f773fb6-69e4-4013-88d7-1842bbd37336-console-serving-cert\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.872790 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-console-config\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.872790 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-trusted-ca-bundle\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.872964 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-service-ca\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.872964 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-oauth-serving-cert\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.872964 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.872890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjhv\" (UniqueName: \"kubernetes.io/projected/9f773fb6-69e4-4013-88d7-1842bbd37336-kube-api-access-kxjhv\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.928627 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.928597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:24.974006 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.973982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-trusted-ca-bundle\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974066 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-service-ca\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974066 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-oauth-serving-cert\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974141 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjhv\" (UniqueName: \"kubernetes.io/projected/9f773fb6-69e4-4013-88d7-1842bbd37336-kube-api-access-kxjhv\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974141 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f773fb6-69e4-4013-88d7-1842bbd37336-console-oauth-config\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974250 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f773fb6-69e4-4013-88d7-1842bbd37336-console-serving-cert\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974305 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-console-config\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.974885 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974861 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-oauth-serving-cert\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.975012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974883 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-service-ca\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.975012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-console-config\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.975012 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.974943 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f773fb6-69e4-4013-88d7-1842bbd37336-trusted-ca-bundle\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.977101 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.977075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f773fb6-69e4-4013-88d7-1842bbd37336-console-oauth-config\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.977313 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.977294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f773fb6-69e4-4013-88d7-1842bbd37336-console-serving-cert\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.982210 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.982186 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjhv\" (UniqueName: \"kubernetes.io/projected/9f773fb6-69e4-4013-88d7-1842bbd37336-kube-api-access-kxjhv\") pod \"console-7c85466689-9964l\" (UID: \"9f773fb6-69e4-4013-88d7-1842bbd37336\") " pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:24.992320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:24.992296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:25.116481 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:25.116400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:25.340574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:25.340545 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn" Sep 18 14:57:25.389279 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:25.389229 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c85466689-9964l"] Sep 18 14:57:25.392129 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:57:25.392087 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f773fb6_69e4_4013_88d7_1842bbd37336.slice/crio-4ec539d41d3a7d1acf1b193213a9494930f7ce338dbb245d6c43b86ea468a28d WatchSource:0}: Error finding container 4ec539d41d3a7d1acf1b193213a9494930f7ce338dbb245d6c43b86ea468a28d: Status 404 returned error can't find the container with id 4ec539d41d3a7d1acf1b193213a9494930f7ce338dbb245d6c43b86ea468a28d Sep 18 14:57:25.586944 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:25.586911 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:25.653358 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:25.653284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:26.392056 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:26.392014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c85466689-9964l" event={"ID":"9f773fb6-69e4-4013-88d7-1842bbd37336","Type":"ContainerStarted","Data":"7b57cbd832aecc37584129853dd39ca665d5d9998d420f10de89f78aa0d22cae"} Sep 18 14:57:26.392420 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:26.392104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c85466689-9964l" event={"ID":"9f773fb6-69e4-4013-88d7-1842bbd37336","Type":"ContainerStarted","Data":"4ec539d41d3a7d1acf1b193213a9494930f7ce338dbb245d6c43b86ea468a28d"} Sep 18 14:57:26.432512 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:26.432438 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c85466689-9964l" podStartSLOduration=2.432421713 podStartE2EDuration="2.432421713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:26.430395815 +0000 UTC m=+371.880105607" watchObservedRunningTime="2026-09-18 14:57:26.432421713 +0000 UTC m=+371.882131486" Sep 18 14:57:27.012574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.012542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:27.129639 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.129607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:27.479424 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.479397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:27.514719 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.514693 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf"] Sep 18 14:57:27.516909 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.516889 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.519160 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.519141 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 14:57:27.519976 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.519954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 14:57:27.519976 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.519970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 14:57:27.520172 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.519976 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-thz27\"" Sep 18 14:57:27.520172 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.519954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 14:57:27.537155 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.537130 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf"] Sep 18 14:57:27.597989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.597963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tmp\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.598100 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.597999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6kdw\" (UniqueName: \"kubernetes.io/projected/aafb72fc-6837-4c8f-8d00-802591a2d7ee-kube-api-access-n6kdw\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.598142 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.598120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tls-certs\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.699086 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.699060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tls-certs\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.699199 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.699096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tmp\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.699199 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.699119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6kdw\" (UniqueName: \"kubernetes.io/projected/aafb72fc-6837-4c8f-8d00-802591a2d7ee-kube-api-access-n6kdw\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.699277 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:57:27.699192 2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 18 14:57:27.699277 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:57:27.699251 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tls-certs podName:aafb72fc-6837-4c8f-8d00-802591a2d7ee nodeName:}" failed. No retries permitted until 2026-09-18 14:57:28.199235015 +0000 UTC m=+373.648944763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tls-certs") pod "kube-auth-proxy-7c4fc4958f-bp2qf" (UID: "aafb72fc-6837-4c8f-8d00-802591a2d7ee") : secret "kube-auth-proxy-tls" not found Sep 18 14:57:27.701345 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.701326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tmp\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.717665 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.717643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6kdw\" (UniqueName: \"kubernetes.io/projected/aafb72fc-6837-4c8f-8d00-802591a2d7ee-kube-api-access-n6kdw\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:27.983161 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:27.983126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:28.204087 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:28.204062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tls-certs\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:28.206370 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:28.206348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aafb72fc-6837-4c8f-8d00-802591a2d7ee-tls-certs\") pod \"kube-auth-proxy-7c4fc4958f-bp2qf\" (UID: \"aafb72fc-6837-4c8f-8d00-802591a2d7ee\") " pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:28.426748 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:28.426723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" Sep 18 14:57:28.724860 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:28.724837 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf"] Sep 18 14:57:28.726806 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:57:28.726782 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafb72fc_6837_4c8f_8d00_802591a2d7ee.slice/crio-727ba6d41ba8510b9c1d9d0ba9c04cb9cb286b3619984c24ab1a9dcbbe4a0a6f WatchSource:0}: Error finding container 727ba6d41ba8510b9c1d9d0ba9c04cb9cb286b3619984c24ab1a9dcbbe4a0a6f: Status 404 returned error can't find the container with id 727ba6d41ba8510b9c1d9d0ba9c04cb9cb286b3619984c24ab1a9dcbbe4a0a6f Sep 18 14:57:29.218117 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:29.218089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:29.307094 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:29.307067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:29.413102 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:29.413034 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" event={"ID":"aafb72fc-6837-4c8f-8d00-802591a2d7ee","Type":"ContainerStarted","Data":"727ba6d41ba8510b9c1d9d0ba9c04cb9cb286b3619984c24ab1a9dcbbe4a0a6f"} Sep 18 14:57:30.255646 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:30.255605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:32.430802 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:32.430771 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" event={"ID":"aafb72fc-6837-4c8f-8d00-802591a2d7ee","Type":"ContainerStarted","Data":"eb4aeb12b59a0cc04c18d1c227df130f46c219a58dbd582aa34359460e40e62a"} Sep 18 14:57:32.446784 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:32.446737 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c4fc4958f-bp2qf" podStartSLOduration=2.694505824 podStartE2EDuration="5.446721192s" totalImagesPullingTime="2.752215368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:32.445136979 +0000 UTC m=+377.894846749" watchObservedRunningTime="2026-09-18 14:57:32.446721192 +0000 UTC m=+377.896430962" Sep 18 14:57:34.234386 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:34.234351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:34.341203 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:34.341175 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:34.516582 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:34.516500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:34.615238 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:34.615210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:34.901683 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:34.901619 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:35.117020 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.116992 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:35.117186 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.117046 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:35.121561 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.121542 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:35.448892 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.448865 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c85466689-9964l" Sep 18 14:57:35.496800 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.496772 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766cb768bf-5hqd9"] Sep 18 14:57:35.615119 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.615086 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:35.677422 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.677389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:35.736072 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:35.736006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:36.142357 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:36.142287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:37.981302 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:37.981254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:38.079459 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:38.079425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:38.179874 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:38.179844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:38.456469 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:38.456437 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:38.555646 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:38.555618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:38.835124 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:38.835054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:40.642011 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:40.641970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:41.815207 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:41.815177 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:42.486191 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:42.486155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:48.798174 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:48.798145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:48.906435 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:48.906407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:49.041988 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:49.041959 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:49.233610 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:49.233582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:50.087477 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:50.087448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:50.190034 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:50.190004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:59.175544 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:59.175485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:57:59.276578 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:57:59.276551 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:00.522447 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.522410 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-766cb768bf-5hqd9" podUID="e009e8d4-4b08-40dd-a21f-676d8926de8c" containerName="console" containerID="cri-o://595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185" gracePeriod=15 Sep 18 14:58:00.760862 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.760835 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:58:00.886808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886724 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-oauth-serving-cert\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.886808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886773 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-serving-cert\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.887022 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-config\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.887022 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886841 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tzrq\" (UniqueName: \"kubernetes.io/projected/e009e8d4-4b08-40dd-a21f-676d8926de8c-kube-api-access-5tzrq\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.887022 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886866 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-service-ca\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.887022 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886893 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-oauth-config\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.887022 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.886943 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-trusted-ca-bundle\") pod \"e009e8d4-4b08-40dd-a21f-676d8926de8c\" (UID: \"e009e8d4-4b08-40dd-a21f-676d8926de8c\") " Sep 18 14:58:00.887280 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.887251 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-config" (OuterVolumeSpecName: "console-config") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:58:00.887452 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.887379 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:58:00.887452 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.887414 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:58:00.887634 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.887554 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:58:00.889078 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.889053 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e009e8d4-4b08-40dd-a21f-676d8926de8c-kube-api-access-5tzrq" (OuterVolumeSpecName: "kube-api-access-5tzrq") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "kube-api-access-5tzrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:58:00.889166 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.889098 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:58:00.889166 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.889114 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e009e8d4-4b08-40dd-a21f-676d8926de8c" (UID: "e009e8d4-4b08-40dd-a21f-676d8926de8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:58:00.987714 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987681 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-trusted-ca-bundle\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:00.987714 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987710 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-oauth-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:00.987714 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987719 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-serving-cert\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:00.987886 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987728 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:00.987886 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987736 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tzrq\" (UniqueName: \"kubernetes.io/projected/e009e8d4-4b08-40dd-a21f-676d8926de8c-kube-api-access-5tzrq\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:00.987886 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987748 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e009e8d4-4b08-40dd-a21f-676d8926de8c-service-ca\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:00.987886 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:00.987762 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e009e8d4-4b08-40dd-a21f-676d8926de8c-console-oauth-config\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:58:01.566720 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.566689 2581 generic.go:356] "Generic (PLEG): container finished" podID="e009e8d4-4b08-40dd-a21f-676d8926de8c" containerID="595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185" exitCode=0 Sep 18 14:58:01.567125 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.566732 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766cb768bf-5hqd9" Sep 18 14:58:01.567125 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.566751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766cb768bf-5hqd9" event={"ID":"e009e8d4-4b08-40dd-a21f-676d8926de8c","Type":"ContainerDied","Data":"595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185"} Sep 18 14:58:01.567125 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.566790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766cb768bf-5hqd9" event={"ID":"e009e8d4-4b08-40dd-a21f-676d8926de8c","Type":"ContainerDied","Data":"b5d4b5c0e19bcce9f3390338ab23cb841f9531c839a94280a8d0dbc3fb4460b6"} Sep 18 14:58:01.567125 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.566809 2581 scope.go:117] "RemoveContainer" containerID="595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185" Sep 18 14:58:01.576018 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.576002 2581 scope.go:117] "RemoveContainer" containerID="595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185" Sep 18 14:58:01.576262 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:58:01.576245 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185\": container with ID starting with 595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185 not found: ID does not exist" containerID="595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185" Sep 18 14:58:01.576313 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.576269 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185"} err="failed to get container status \"595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185\": rpc error: code = NotFound desc = could not find container \"595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185\": container with ID starting with 595317f4698b33e5ebffcff6cd6e25464085e3291bc36b23bcfd48329fd6d185 not found: ID does not exist" Sep 18 14:58:01.586852 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.586830 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766cb768bf-5hqd9"] Sep 18 14:58:01.590097 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:01.590076 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766cb768bf-5hqd9"] Sep 18 14:58:02.661423 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:02.661391 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e009e8d4-4b08-40dd-a21f-676d8926de8c" path="/var/lib/kubelet/pods/e009e8d4-4b08-40dd-a21f-676d8926de8c/volumes" Sep 18 14:58:22.005865 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:22.005836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:39.111619 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:39.111530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:39.212332 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:39.212304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:51.019589 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:51.019556 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:51.813169 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:51.813132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:54.883150 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:54.883119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:54.984989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:54.984956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:55.077313 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:55.077284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:56.868867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:56.868836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:57.016048 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:57.016023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:57.419295 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:57.419262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:57.517809 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:57.517782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:57.627779 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:57.627747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:57.863717 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:57.863684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:57.960542 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:57.960508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:58.065742 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:58.065713 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:58:58.169153 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:58:58.169082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:01.482738 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:01.482710 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:02.068158 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:02.068123 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:03.257999 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.257970 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8"] Sep 18 14:59:03.258395 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.258338 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e009e8d4-4b08-40dd-a21f-676d8926de8c" containerName="console" Sep 18 14:59:03.258395 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.258349 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e009e8d4-4b08-40dd-a21f-676d8926de8c" containerName="console" Sep 18 14:59:03.258482 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.258402 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e009e8d4-4b08-40dd-a21f-676d8926de8c" containerName="console" Sep 18 14:59:03.261210 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.261194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:03.263831 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.263804 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 14:59:03.263963 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.263849 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hzscp\"" Sep 18 14:59:03.263963 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.263895 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 18 14:59:03.264088 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.263970 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 14:59:03.274805 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.274411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8"] Sep 18 14:59:03.391264 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.391233 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dvvd\" (UniqueName: \"kubernetes.io/projected/cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed-kube-api-access-4dvvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-6k4l8\" (UID: \"cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:03.491798 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.491773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dvvd\" (UniqueName: \"kubernetes.io/projected/cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed-kube-api-access-4dvvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-6k4l8\" (UID: \"cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:03.501822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.501793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dvvd\" (UniqueName: \"kubernetes.io/projected/cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed-kube-api-access-4dvvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-6k4l8\" (UID: \"cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:03.578900 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.578841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:03.863454 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:03.863429 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8"] Sep 18 14:59:03.865248 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:59:03.865223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf570e0_e5c4_4d07_a1c3_3f6bbe46faed.slice/crio-451e476c90846535cfdbc8dba9511f1796f99d66be30d9407aad56f2630d2689 WatchSource:0}: Error finding container 451e476c90846535cfdbc8dba9511f1796f99d66be30d9407aad56f2630d2689: Status 404 returned error can't find the container with id 451e476c90846535cfdbc8dba9511f1796f99d66be30d9407aad56f2630d2689 Sep 18 14:59:04.422717 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:04.422688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:04.523328 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:04.523276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:04.827292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:04.827226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:04.859968 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:04.859929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" event={"ID":"cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed","Type":"ContainerStarted","Data":"451e476c90846535cfdbc8dba9511f1796f99d66be30d9407aad56f2630d2689"} Sep 18 14:59:04.929937 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:04.929895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:06.873442 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:06.873408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" event={"ID":"cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed","Type":"ContainerStarted","Data":"16cc07b8c60de95963112f73c2296df043c5dcaa589f3531f6b8925373554c32"} Sep 18 14:59:06.873833 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:06.873520 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:06.894822 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:06.894779 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" podStartSLOduration=1.572404579 podStartE2EDuration="3.894765434s" totalImagesPullingTime="2.322360855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:59:06.893202347 +0000 UTC m=+472.342912129" watchObservedRunningTime="2026-09-18 14:59:06.894765434 +0000 UTC m=+472.344475204" Sep 18 14:59:08.028801 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:08.028767 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:08.129562 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:08.129532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:09.710660 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:09.710628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:09.811116 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:09.811078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:11.991288 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:11.991227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:12.091466 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:12.091442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:12.191324 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:12.191297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:14.782810 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:14.782778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:15.149291 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:15.149209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:17.880098 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:17.880068 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6k4l8" Sep 18 14:59:18.522073 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:18.522042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:18.618830 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:18.618798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:24.039349 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:24.039314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:24.146458 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:24.146431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:24.721788 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:24.721757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:24.879320 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:24.879288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:25.384085 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.384051 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx"] Sep 18 14:59:25.387808 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.387792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.390224 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.390202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k6qfq\"" Sep 18 14:59:25.402239 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.402214 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx"] Sep 18 14:59:25.477161 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.477134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00deaa74-1584-4cfd-8592-3305b4b1de51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.477294 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.477170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppg9w\" (UniqueName: \"kubernetes.io/projected/00deaa74-1584-4cfd-8592-3305b4b1de51-kube-api-access-ppg9w\") pod \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.578435 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.578405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00deaa74-1584-4cfd-8592-3305b4b1de51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.578567 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.578443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppg9w\" (UniqueName: \"kubernetes.io/projected/00deaa74-1584-4cfd-8592-3305b4b1de51-kube-api-access-ppg9w\") pod \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.578806 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.578786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00deaa74-1584-4cfd-8592-3305b4b1de51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.587574 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.587553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppg9w\" (UniqueName: \"kubernetes.io/projected/00deaa74-1584-4cfd-8592-3305b4b1de51-kube-api-access-ppg9w\") pod \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.697561 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.697536 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:25.972331 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:25.972174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx"] Sep 18 14:59:25.974946 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:59:25.974920 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00deaa74_1584_4cfd_8592_3305b4b1de51.slice/crio-e89098e75b78f132333faf79cc1a330277157a93a27f40a1879f82193ec8b10f WatchSource:0}: Error finding container e89098e75b78f132333faf79cc1a330277157a93a27f40a1879f82193ec8b10f: Status 404 returned error can't find the container with id e89098e75b78f132333faf79cc1a330277157a93a27f40a1879f82193ec8b10f Sep 18 14:59:26.005901 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.005876 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx"] Sep 18 14:59:26.011510 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.011476 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx"] Sep 18 14:59:26.099300 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.099266 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff"] Sep 18 14:59:26.104282 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.104261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:26.106773 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.106749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5cwcm\"" Sep 18 14:59:26.117105 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.117083 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff"] Sep 18 14:59:26.185617 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.185588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bh7f\" (UniqueName: \"kubernetes.io/projected/d1ff1467-5052-4e91-a296-726ad17657e1-kube-api-access-2bh7f\") pod \"limitador-operator-controller-manager-74495c69f8-cznff\" (UID: \"d1ff1467-5052-4e91-a296-726ad17657e1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:26.286512 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.286421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bh7f\" (UniqueName: \"kubernetes.io/projected/d1ff1467-5052-4e91-a296-726ad17657e1-kube-api-access-2bh7f\") pod \"limitador-operator-controller-manager-74495c69f8-cznff\" (UID: \"d1ff1467-5052-4e91-a296-726ad17657e1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:26.297372 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.297345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bh7f\" (UniqueName: \"kubernetes.io/projected/d1ff1467-5052-4e91-a296-726ad17657e1-kube-api-access-2bh7f\") pod \"limitador-operator-controller-manager-74495c69f8-cznff\" (UID: \"d1ff1467-5052-4e91-a296-726ad17657e1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:26.416820 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.416791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:26.708082 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.708057 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff"] Sep 18 14:59:26.710999 ip-10-0-131-100 kubenswrapper[2581]: W0918 14:59:26.710959 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ff1467_5052_4e91_a296_726ad17657e1.slice/crio-608673878d45f645174b0a64672b3e44d3c7be22823d9863674c0d2ea2a9e1a4 WatchSource:0}: Error finding container 608673878d45f645174b0a64672b3e44d3c7be22823d9863674c0d2ea2a9e1a4: Status 404 returned error can't find the container with id 608673878d45f645174b0a64672b3e44d3c7be22823d9863674c0d2ea2a9e1a4 Sep 18 14:59:26.970866 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:26.970782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" event={"ID":"d1ff1467-5052-4e91-a296-726ad17657e1","Type":"ContainerStarted","Data":"608673878d45f645174b0a64672b3e44d3c7be22823d9863674c0d2ea2a9e1a4"} Sep 18 14:59:28.265508 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:28.265459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:28.366643 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:28.366609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:29.990555 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:29.990522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" event={"ID":"d1ff1467-5052-4e91-a296-726ad17657e1","Type":"ContainerStarted","Data":"759038cfea2e3371bdfd9bf64cb06dc6c8ec6b1031e1b3c06887f27bcd8df93b"} Sep 18 14:59:29.990972 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:29.990644 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:29.992227 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:29.992201 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" containerName="manager" containerID="cri-o://1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e" gracePeriod=2 Sep 18 14:59:30.010076 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.010038 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" podStartSLOduration=2.49326704 podStartE2EDuration="4.010025201s" totalImagesPullingTime="1.516758161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:59:30.009110791 +0000 UTC m=+495.458820561" watchObservedRunningTime="2026-09-18 14:59:30.010025201 +0000 UTC m=+495.459734971" Sep 18 14:59:30.225652 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.225625 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:30.227844 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:59:30.227823 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" is forbidden: User \"system:node:ip-10-0-131-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-100.ec2.internal' and this object" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:30.325292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.325236 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00deaa74-1584-4cfd-8592-3305b4b1de51-extensions-socket-volume\") pod \"00deaa74-1584-4cfd-8592-3305b4b1de51\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " Sep 18 14:59:30.325292 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.325280 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppg9w\" (UniqueName: \"kubernetes.io/projected/00deaa74-1584-4cfd-8592-3305b4b1de51-kube-api-access-ppg9w\") pod \"00deaa74-1584-4cfd-8592-3305b4b1de51\" (UID: \"00deaa74-1584-4cfd-8592-3305b4b1de51\") " Sep 18 14:59:30.325550 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.325529 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00deaa74-1584-4cfd-8592-3305b4b1de51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "00deaa74-1584-4cfd-8592-3305b4b1de51" (UID: "00deaa74-1584-4cfd-8592-3305b4b1de51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:59:30.327403 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.327384 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00deaa74-1584-4cfd-8592-3305b4b1de51-kube-api-access-ppg9w" (OuterVolumeSpecName: "kube-api-access-ppg9w") pod "00deaa74-1584-4cfd-8592-3305b4b1de51" (UID: "00deaa74-1584-4cfd-8592-3305b4b1de51"). InnerVolumeSpecName "kube-api-access-ppg9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:59:30.426378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.426354 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00deaa74-1584-4cfd-8592-3305b4b1de51-extensions-socket-volume\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:59:30.426378 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.426377 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppg9w\" (UniqueName: \"kubernetes.io/projected/00deaa74-1584-4cfd-8592-3305b4b1de51-kube-api-access-ppg9w\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 14:59:30.662469 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.662384 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" path="/var/lib/kubelet/pods/00deaa74-1584-4cfd-8592-3305b4b1de51/volumes" Sep 18 14:59:30.998242 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.998209 2581 generic.go:356] "Generic (PLEG): container finished" podID="00deaa74-1584-4cfd-8592-3305b4b1de51" containerID="1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e" exitCode=2 Sep 18 14:59:30.998242 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.998247 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:30.998736 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:30.998268 2581 scope.go:117] "RemoveContainer" containerID="1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e" Sep 18 14:59:31.002664 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:59:31.002632 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-p44qx\" is forbidden: User \"system:node:ip-10-0-131-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-100.ec2.internal' and this object" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-p44qx" Sep 18 14:59:31.006770 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:31.006754 2581 scope.go:117] "RemoveContainer" containerID="1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e" Sep 18 14:59:31.007050 ip-10-0-131-100 kubenswrapper[2581]: E0918 14:59:31.007028 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e\": container with ID starting with 1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e not found: ID does not exist" containerID="1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e" Sep 18 14:59:31.007115 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:31.007061 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e"} err="failed to get container status \"1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e\": rpc error: code = NotFound desc = could not find container \"1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e\": container with ID starting with 1fca5a7797b7cfb2937d9f19138597cb91c32a4a1af999aac09fe1beb54d375e not found: ID does not exist" Sep 18 14:59:32.234867 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:32.234838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:32.336555 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:32.336520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:32.434987 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:32.434934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:32.490551 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:32.490430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:32.643711 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:32.643667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:32.743364 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:32.743250 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:38.646132 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:38.646081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:38.746632 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:38.746606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:41.000613 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:41.000584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cznff" Sep 18 14:59:51.393260 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:51.393225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:54.431356 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:54.431327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:54.535181 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:54.535153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:55.316989 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:55.316942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 14:59:55.382624 ip-10-0-131-100 kubenswrapper[2581]: I0918 14:59:55.382589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:08.662848 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:08.662771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:08.762113 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:08.762081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:08.823608 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:08.823565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:09.512769 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.512736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:09.599063 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.599031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:09.599786 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.599766 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-ndtf2"] Sep 18 15:00:09.600201 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.600186 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" containerName="manager" Sep 18 15:00:09.600275 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.600204 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" containerName="manager" Sep 18 15:00:09.600331 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.600311 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00deaa74-1584-4cfd-8592-3305b4b1de51" containerName="manager" Sep 18 15:00:09.602207 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.602180 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:09.604769 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.604753 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cgjfp\"" Sep 18 15:00:09.610332 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.610310 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ndtf2"] Sep 18 15:00:09.754692 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.754662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58z8\" (UniqueName: \"kubernetes.io/projected/50db5641-b2b5-477f-9861-17afa2599b44-kube-api-access-c58z8\") pod \"authorino-59c974bd48-ndtf2\" (UID: \"50db5641-b2b5-477f-9861-17afa2599b44\") " pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:09.855760 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.855691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58z8\" (UniqueName: \"kubernetes.io/projected/50db5641-b2b5-477f-9861-17afa2599b44-kube-api-access-c58z8\") pod \"authorino-59c974bd48-ndtf2\" (UID: \"50db5641-b2b5-477f-9861-17afa2599b44\") " pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:09.867824 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.867799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58z8\" (UniqueName: \"kubernetes.io/projected/50db5641-b2b5-477f-9861-17afa2599b44-kube-api-access-c58z8\") pod \"authorino-59c974bd48-ndtf2\" (UID: \"50db5641-b2b5-477f-9861-17afa2599b44\") " pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:09.911830 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:09.911800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:10.177022 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:10.177000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ndtf2"] Sep 18 15:00:10.179477 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:00:10.179445 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50db5641_b2b5_477f_9861_17afa2599b44.slice/crio-976d90ee8465225ffe7ef5d16af87aae2641b6139437a5ee35c1a844a6c6c069 WatchSource:0}: Error finding container 976d90ee8465225ffe7ef5d16af87aae2641b6139437a5ee35c1a844a6c6c069: Status 404 returned error can't find the container with id 976d90ee8465225ffe7ef5d16af87aae2641b6139437a5ee35c1a844a6c6c069 Sep 18 15:00:10.188224 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:10.188201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ndtf2" event={"ID":"50db5641-b2b5-477f-9861-17afa2599b44","Type":"ContainerStarted","Data":"976d90ee8465225ffe7ef5d16af87aae2641b6139437a5ee35c1a844a6c6c069"} Sep 18 15:00:13.204422 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:13.204389 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ndtf2" event={"ID":"50db5641-b2b5-477f-9861-17afa2599b44","Type":"ContainerStarted","Data":"4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1"} Sep 18 15:00:13.222069 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:13.222018 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-ndtf2" podStartSLOduration=2.253877441 podStartE2EDuration="4.22200253s" totalImagesPullingTime="1.968125089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:13.22059714 +0000 UTC m=+538.670306910" watchObservedRunningTime="2026-09-18 15:00:13.22200253 +0000 UTC m=+538.671712554" Sep 18 15:00:28.711096 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:28.711063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:28.811004 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:28.810974 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:28.940686 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:28.940658 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:41.646969 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:41.646929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:41.951108 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:41.951070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:42.142693 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.142662 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f754c67fb-tvdhw"] Sep 18 15:00:42.144922 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.144901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:42.153091 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.153062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f754c67fb-tvdhw"] Sep 18 15:00:42.192614 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.192588 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f754c67fb-tvdhw"] Sep 18 15:00:42.192826 ip-10-0-131-100 kubenswrapper[2581]: E0918 15:00:42.192809 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hfzzh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5f754c67fb-tvdhw" podUID="998e2b8c-a74c-4ec0-a411-5d428ab89065" Sep 18 15:00:42.221294 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.221233 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfzzh\" (UniqueName: \"kubernetes.io/projected/998e2b8c-a74c-4ec0-a411-5d428ab89065-kube-api-access-hfzzh\") pod \"authorino-5f754c67fb-tvdhw\" (UID: \"998e2b8c-a74c-4ec0-a411-5d428ab89065\") " pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:42.322283 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.322257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfzzh\" (UniqueName: \"kubernetes.io/projected/998e2b8c-a74c-4ec0-a411-5d428ab89065-kube-api-access-hfzzh\") pod \"authorino-5f754c67fb-tvdhw\" (UID: \"998e2b8c-a74c-4ec0-a411-5d428ab89065\") " pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:42.334768 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.334746 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfzzh\" (UniqueName: \"kubernetes.io/projected/998e2b8c-a74c-4ec0-a411-5d428ab89065-kube-api-access-hfzzh\") pod \"authorino-5f754c67fb-tvdhw\" (UID: \"998e2b8c-a74c-4ec0-a411-5d428ab89065\") " pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:42.345512 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.345477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:42.351163 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.351148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:42.422954 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.422934 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfzzh\" (UniqueName: \"kubernetes.io/projected/998e2b8c-a74c-4ec0-a411-5d428ab89065-kube-api-access-hfzzh\") pod \"998e2b8c-a74c-4ec0-a411-5d428ab89065\" (UID: \"998e2b8c-a74c-4ec0-a411-5d428ab89065\") " Sep 18 15:00:42.424869 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.424851 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998e2b8c-a74c-4ec0-a411-5d428ab89065-kube-api-access-hfzzh" (OuterVolumeSpecName: "kube-api-access-hfzzh") pod "998e2b8c-a74c-4ec0-a411-5d428ab89065" (UID: "998e2b8c-a74c-4ec0-a411-5d428ab89065"). InnerVolumeSpecName "kube-api-access-hfzzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:00:42.523921 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:42.523867 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfzzh\" (UniqueName: \"kubernetes.io/projected/998e2b8c-a74c-4ec0-a411-5d428ab89065-kube-api-access-hfzzh\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 15:00:43.350301 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:43.350270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f754c67fb-tvdhw" Sep 18 15:00:43.376532 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:43.376498 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f754c67fb-tvdhw"] Sep 18 15:00:43.380438 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:43.380415 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f754c67fb-tvdhw"] Sep 18 15:00:44.370368 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.370335 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ndtf2"] Sep 18 15:00:44.370840 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.370551 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-ndtf2" podUID="50db5641-b2b5-477f-9861-17afa2599b44" containerName="authorino" containerID="cri-o://4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1" gracePeriod=30 Sep 18 15:00:44.614635 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.614613 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:44.662229 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.662151 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="998e2b8c-a74c-4ec0-a411-5d428ab89065" path="/var/lib/kubelet/pods/998e2b8c-a74c-4ec0-a411-5d428ab89065/volumes" Sep 18 15:00:44.744852 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.744831 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c58z8\" (UniqueName: \"kubernetes.io/projected/50db5641-b2b5-477f-9861-17afa2599b44-kube-api-access-c58z8\") pod \"50db5641-b2b5-477f-9861-17afa2599b44\" (UID: \"50db5641-b2b5-477f-9861-17afa2599b44\") " Sep 18 15:00:44.746823 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.746800 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50db5641-b2b5-477f-9861-17afa2599b44-kube-api-access-c58z8" (OuterVolumeSpecName: "kube-api-access-c58z8") pod "50db5641-b2b5-477f-9861-17afa2599b44" (UID: "50db5641-b2b5-477f-9861-17afa2599b44"). InnerVolumeSpecName "kube-api-access-c58z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:00:44.845895 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:44.845850 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c58z8\" (UniqueName: \"kubernetes.io/projected/50db5641-b2b5-477f-9861-17afa2599b44-kube-api-access-c58z8\") on node \"ip-10-0-131-100.ec2.internal\" DevicePath \"\"" Sep 18 15:00:45.361770 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.361737 2581 generic.go:356] "Generic (PLEG): container finished" podID="50db5641-b2b5-477f-9861-17afa2599b44" containerID="4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1" exitCode=0 Sep 18 15:00:45.361937 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.361781 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ndtf2" Sep 18 15:00:45.361937 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.361806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ndtf2" event={"ID":"50db5641-b2b5-477f-9861-17afa2599b44","Type":"ContainerDied","Data":"4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1"} Sep 18 15:00:45.361937 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.361837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ndtf2" event={"ID":"50db5641-b2b5-477f-9861-17afa2599b44","Type":"ContainerDied","Data":"976d90ee8465225ffe7ef5d16af87aae2641b6139437a5ee35c1a844a6c6c069"} Sep 18 15:00:45.361937 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.361858 2581 scope.go:117] "RemoveContainer" containerID="4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1" Sep 18 15:00:45.370390 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.370372 2581 scope.go:117] "RemoveContainer" containerID="4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1" Sep 18 15:00:45.370700 ip-10-0-131-100 kubenswrapper[2581]: E0918 15:00:45.370681 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1\": container with ID starting with 4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1 not found: ID does not exist" containerID="4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1" Sep 18 15:00:45.370746 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.370710 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1"} err="failed to get container status \"4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1\": rpc error: code = NotFound desc = could not find container \"4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1\": container with ID starting with 4332b5efb4ec72259f941ba496a4d17e6dce099104bd7997028375141ad621c1 not found: ID does not exist" Sep 18 15:00:45.383645 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.383621 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ndtf2"] Sep 18 15:00:45.387557 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:45.387539 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ndtf2"] Sep 18 15:00:46.664186 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:46.664155 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50db5641-b2b5-477f-9861-17afa2599b44" path="/var/lib/kubelet/pods/50db5641-b2b5-477f-9861-17afa2599b44/volumes" Sep 18 15:00:49.893101 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:49.893068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:49.985912 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:49.985880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:50.087762 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:50.087727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:50.381061 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:50.381031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:53.482332 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:53.482297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:53.572684 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:53.572654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:59.201293 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:59.201260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:00:59.301874 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:00:59.301845 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:16.588636 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:16.588608 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 15:01:16.591927 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:16.591906 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 15:01:24.988924 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:24.988881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:26.290428 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.290393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:26.584752 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.584668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:26.682693 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.682660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:26.733062 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.733032 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb"] Sep 18 15:01:26.733409 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.733397 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50db5641-b2b5-477f-9861-17afa2599b44" containerName="authorino" Sep 18 15:01:26.733459 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.733410 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="50db5641-b2b5-477f-9861-17afa2599b44" containerName="authorino" Sep 18 15:01:26.733527 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.733506 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="50db5641-b2b5-477f-9861-17afa2599b44" containerName="authorino" Sep 18 15:01:26.736729 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.736714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.740334 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.740317 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 18 15:01:26.740334 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.740324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 18 15:01:26.740541 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.740380 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j9gkf\"" Sep 18 15:01:26.740541 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.740324 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 18 15:01:26.740541 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.740328 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 18 15:01:26.747549 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.747478 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb"] Sep 18 15:01:26.762351 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.762326 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:26.811170 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.811147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53a16d-b414-485b-854a-22b0b70457e8-metrics-certs\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.811315 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.811193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xb2w\" (UniqueName: \"kubernetes.io/projected/0c53a16d-b414-485b-854a-22b0b70457e8-kube-api-access-6xb2w\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.811315 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.811231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c53a16d-b414-485b-854a-22b0b70457e8-maas-api-tls\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.811315 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.811263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c53a16d-b414-485b-854a-22b0b70457e8-openshift-service-ca\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.912058 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.911963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53a16d-b414-485b-854a-22b0b70457e8-metrics-certs\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.912058 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.912018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xb2w\" (UniqueName: \"kubernetes.io/projected/0c53a16d-b414-485b-854a-22b0b70457e8-kube-api-access-6xb2w\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.912058 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.912054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c53a16d-b414-485b-854a-22b0b70457e8-maas-api-tls\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.912298 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.912086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c53a16d-b414-485b-854a-22b0b70457e8-openshift-service-ca\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.912794 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.912773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c53a16d-b414-485b-854a-22b0b70457e8-openshift-service-ca\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.914466 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.914446 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53a16d-b414-485b-854a-22b0b70457e8-metrics-certs\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.914566 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.914518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c53a16d-b414-485b-854a-22b0b70457e8-maas-api-tls\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:26.920291 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:26.920267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xb2w\" (UniqueName: \"kubernetes.io/projected/0c53a16d-b414-485b-854a-22b0b70457e8-kube-api-access-6xb2w\") pod \"maas-api-59f6566bbc-4llbb\" (UID: \"0c53a16d-b414-485b-854a-22b0b70457e8\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:27.049315 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:27.049281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:27.127278 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:27.127248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:27.256990 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:27.256957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:27.332225 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:27.332201 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb"] Sep 18 15:01:27.335141 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:01:27.335073 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c53a16d_b414_485b_854a_22b0b70457e8.slice/crio-21703222def2949256ec8197f4ee9597bc313e22f82dcda59b8e2aa9c028a6cb WatchSource:0}: Error finding container 21703222def2949256ec8197f4ee9597bc313e22f82dcda59b8e2aa9c028a6cb: Status 404 returned error can't find the container with id 21703222def2949256ec8197f4ee9597bc313e22f82dcda59b8e2aa9c028a6cb Sep 18 15:01:27.562252 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:27.562174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" event={"ID":"0c53a16d-b414-485b-854a-22b0b70457e8","Type":"ContainerStarted","Data":"21703222def2949256ec8197f4ee9597bc313e22f82dcda59b8e2aa9c028a6cb"} Sep 18 15:01:30.583364 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:30.583326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" event={"ID":"0c53a16d-b414-485b-854a-22b0b70457e8","Type":"ContainerStarted","Data":"f2901b1dfa5414fbee724032164c5a8038054e50f086e495911dce997a5f29f8"} Sep 18 15:01:30.583871 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:30.583388 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:30.600146 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:30.600098 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" podStartSLOduration=2.390945425 podStartE2EDuration="4.600081994s" totalImagesPullingTime="2.209136569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:01:30.598073421 +0000 UTC m=+616.047783192" watchObservedRunningTime="2026-09-18 15:01:30.600081994 +0000 UTC m=+616.049791781" Sep 18 15:01:36.593536 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:36.593508 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-4llbb" Sep 18 15:01:37.622623 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:37.622584 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:37.717796 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:37.717766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:50.056079 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.056050 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw"] Sep 18 15:01:50.064747 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.064727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.067617 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.067089 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 15:01:50.068345 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.067947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 18 15:01:50.068345 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.067985 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 15:01:50.068345 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.068024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l7zwm\"" Sep 18 15:01:50.069709 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.069690 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw"] Sep 18 15:01:50.098898 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.098871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:01:50.116157 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.116130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44sx\" (UniqueName: \"kubernetes.io/projected/a313e278-c789-4a0b-98b9-abcbcb1562d2-kube-api-access-h44sx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.116263 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.116183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a313e278-c789-4a0b-98b9-abcbcb1562d2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.116317 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.116259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.116364 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.116317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.116409 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.116363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.116409 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.116397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217264 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217370 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217370 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217370 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44sx\" (UniqueName: \"kubernetes.io/projected/a313e278-c789-4a0b-98b9-abcbcb1562d2-kube-api-access-h44sx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217370 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a313e278-c789-4a0b-98b9-abcbcb1562d2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217603 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217697 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217675 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217755 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217713 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.217790 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.217775 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.219589 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.219567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a313e278-c789-4a0b-98b9-abcbcb1562d2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.219865 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.219846 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a313e278-c789-4a0b-98b9-abcbcb1562d2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.224868 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.224846 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44sx\" (UniqueName: \"kubernetes.io/projected/a313e278-c789-4a0b-98b9-abcbcb1562d2-kube-api-access-h44sx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw\" (UID: \"a313e278-c789-4a0b-98b9-abcbcb1562d2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.375935 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.375880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:01:50.650378 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.650352 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw"] Sep 18 15:01:50.652540 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:01:50.652513 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda313e278_c789_4a0b_98b9_abcbcb1562d2.slice/crio-3252fec665eb733372f25266c06d446e72b08ad4f8d84595ccaf7c58f28bb875 WatchSource:0}: Error finding container 3252fec665eb733372f25266c06d446e72b08ad4f8d84595ccaf7c58f28bb875: Status 404 returned error can't find the container with id 3252fec665eb733372f25266c06d446e72b08ad4f8d84595ccaf7c58f28bb875 Sep 18 15:01:50.653909 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.653888 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 15:01:50.677274 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:50.677245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" event={"ID":"a313e278-c789-4a0b-98b9-abcbcb1562d2","Type":"ContainerStarted","Data":"3252fec665eb733372f25266c06d446e72b08ad4f8d84595ccaf7c58f28bb875"} Sep 18 15:01:52.688401 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:52.688368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" event={"ID":"a313e278-c789-4a0b-98b9-abcbcb1562d2","Type":"ContainerStarted","Data":"05626b0d4ed8e4dea84836b3ba2e22bdf66113124251890363cd6031d7cbac0c"} Sep 18 15:01:52.708222 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:01:52.708175 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" podStartSLOduration=1.56880766 podStartE2EDuration="2.708160803s" totalImagesPullingTime="1.139353143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:01:52.706693745 +0000 UTC m=+638.156403518" watchObservedRunningTime="2026-09-18 15:01:52.708160803 +0000 UTC m=+638.157870573" Sep 18 15:02:00.376822 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:00.376786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:02:00.377339 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:00.376876 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:02:00.389641 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:00.389617 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:02:00.428450 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:00.428419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:00.737425 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:00.737400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j5cgw" Sep 18 15:02:02.965084 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:02.965048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:07.934305 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.934275 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4"] Sep 18 15:02:07.937889 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.937870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.940091 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.940072 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 18 15:02:07.947523 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.947481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4"] Sep 18 15:02:07.962186 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.962165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nw4z\" (UniqueName: \"kubernetes.io/projected/9c964190-03cf-4c19-b540-8bf831c4bfd9-kube-api-access-4nw4z\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.962271 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.962197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.962311 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.962283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.962311 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.962305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.962381 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.962363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.962422 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.962384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c964190-03cf-4c19-b540-8bf831c4bfd9-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:07.968197 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:07.968174 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:08.063373 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063522 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063522 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063651 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c964190-03cf-4c19-b540-8bf831c4bfd9-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063651 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nw4z\" (UniqueName: \"kubernetes.io/projected/9c964190-03cf-4c19-b540-8bf831c4bfd9-kube-api-access-4nw4z\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063651 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063819 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063716 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063888 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.063969 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.063948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.065712 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.065697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c964190-03cf-4c19-b540-8bf831c4bfd9-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.065888 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.065872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c964190-03cf-4c19-b540-8bf831c4bfd9-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.071316 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.071300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nw4z\" (UniqueName: \"kubernetes.io/projected/9c964190-03cf-4c19-b540-8bf831c4bfd9-kube-api-access-4nw4z\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4\" (UID: \"9c964190-03cf-4c19-b540-8bf831c4bfd9\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.249784 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.249721 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:08.522011 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.521931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4"] Sep 18 15:02:08.525822 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:02:08.525790 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c964190_03cf_4c19_b540_8bf831c4bfd9.slice/crio-6190dc3818b1bb427067d057fb10d285247dbe5223b174a640d98096af5fe627 WatchSource:0}: Error finding container 6190dc3818b1bb427067d057fb10d285247dbe5223b174a640d98096af5fe627: Status 404 returned error can't find the container with id 6190dc3818b1bb427067d057fb10d285247dbe5223b174a640d98096af5fe627 Sep 18 15:02:08.765414 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:08.765391 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" event={"ID":"9c964190-03cf-4c19-b540-8bf831c4bfd9","Type":"ContainerStarted","Data":"6190dc3818b1bb427067d057fb10d285247dbe5223b174a640d98096af5fe627"} Sep 18 15:02:09.771434 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:09.771394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" event={"ID":"9c964190-03cf-4c19-b540-8bf831c4bfd9","Type":"ContainerStarted","Data":"606cd056303c800a59ffd7cb618dea479d8f49c93f927a0139dde8a24d4f28a5"} Sep 18 15:02:09.791876 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:09.791823 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" podStartSLOduration=2.594081645 podStartE2EDuration="2.791806243s" totalImagesPullingTime="197.724598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:02:09.790156385 +0000 UTC m=+655.239866167" watchObservedRunningTime="2026-09-18 15:02:09.791806243 +0000 UTC m=+655.241516033" Sep 18 15:02:18.250555 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:18.250521 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:18.251012 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:18.250585 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:18.263401 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:18.263377 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:18.280062 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:18.280030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:18.825078 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:18.825050 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w49w4" Sep 18 15:02:22.275773 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:22.275737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:28.634075 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.634044 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d"] Sep 18 15:02:28.641536 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.641515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.644159 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.644136 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 18 15:02:28.651025 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.651002 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d"] Sep 18 15:02:28.682914 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.682888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:28.741001 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.740968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.741162 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.741036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d727w\" (UniqueName: \"kubernetes.io/projected/35db7b10-c053-4914-9620-58b98cfe86de-kube-api-access-d727w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.741213 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.741171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.741213 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.741201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.741318 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.741219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.741318 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.741239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35db7b10-c053-4914-9620-58b98cfe86de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.842737 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.842698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.842932 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.842749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d727w\" (UniqueName: \"kubernetes.io/projected/35db7b10-c053-4914-9620-58b98cfe86de-kube-api-access-d727w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.842932 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.842777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.842932 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.842811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.842932 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.842836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.842932 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.842857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35db7b10-c053-4914-9620-58b98cfe86de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.843254 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.843229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.843314 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.843263 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.843314 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.843287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.845014 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.844992 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35db7b10-c053-4914-9620-58b98cfe86de-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.845248 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.845229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35db7b10-c053-4914-9620-58b98cfe86de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.850631 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.850612 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d727w\" (UniqueName: \"kubernetes.io/projected/35db7b10-c053-4914-9620-58b98cfe86de-kube-api-access-d727w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqs9d\" (UID: \"35db7b10-c053-4914-9620-58b98cfe86de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:28.953423 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:28.953402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:29.230871 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:29.227514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d"] Sep 18 15:02:29.232803 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:02:29.232775 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35db7b10_c053_4914_9620_58b98cfe86de.slice/crio-4b2e2eec0f41733a2b72117512d9979c876435172bc4d026dfa735e83a62386b WatchSource:0}: Error finding container 4b2e2eec0f41733a2b72117512d9979c876435172bc4d026dfa735e83a62386b: Status 404 returned error can't find the container with id 4b2e2eec0f41733a2b72117512d9979c876435172bc4d026dfa735e83a62386b Sep 18 15:02:29.868790 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:29.868705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" event={"ID":"35db7b10-c053-4914-9620-58b98cfe86de","Type":"ContainerStarted","Data":"25634bc9566b1337d52bb61f0ef728f323ae270bddf51103a2feddb9cfcd377f"} Sep 18 15:02:29.868790 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:29.868763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" event={"ID":"35db7b10-c053-4914-9620-58b98cfe86de","Type":"ContainerStarted","Data":"4b2e2eec0f41733a2b72117512d9979c876435172bc4d026dfa735e83a62386b"} Sep 18 15:02:34.630649 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.630587 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" podStartSLOduration=6.40633967 podStartE2EDuration="6.630564037s" totalImagesPullingTime="224.224367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:02:29.885693034 +0000 UTC m=+675.335402806" watchObservedRunningTime="2026-09-18 15:02:34.630564037 +0000 UTC m=+680.080273809" Sep 18 15:02:34.632349 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.632329 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv"] Sep 18 15:02:34.635908 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.635895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.638470 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.638449 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 18 15:02:34.647974 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.647949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv"] Sep 18 15:02:34.681613 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.681587 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:34.800962 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.800935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.801069 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.800989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461e4e1d-02b1-4f21-9cff-de620e3bf238-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.801069 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.801011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlrtj\" (UniqueName: \"kubernetes.io/projected/461e4e1d-02b1-4f21-9cff-de620e3bf238-kube-api-access-jlrtj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.801069 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.801054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.801069 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.801068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.801209 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.801127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902618 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902618 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461e4e1d-02b1-4f21-9cff-de620e3bf238-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902808 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlrtj\" (UniqueName: \"kubernetes.io/projected/461e4e1d-02b1-4f21-9cff-de620e3bf238-kube-api-access-jlrtj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902858 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902902 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902958 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.902958 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.902928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.903220 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.903201 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.903296 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.903244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.905402 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.905362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461e4e1d-02b1-4f21-9cff-de620e3bf238-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.905833 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.905811 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461e4e1d-02b1-4f21-9cff-de620e3bf238-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.913899 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.913875 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlrtj\" (UniqueName: \"kubernetes.io/projected/461e4e1d-02b1-4f21-9cff-de620e3bf238-kube-api-access-jlrtj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv\" (UID: \"461e4e1d-02b1-4f21-9cff-de620e3bf238\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:34.945736 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:34.945711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:35.215742 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:35.215717 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv"] Sep 18 15:02:35.217814 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:02:35.217785 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461e4e1d_02b1_4f21_9cff_de620e3bf238.slice/crio-20455e139d1fff45b63f12abbcae38b479cf8256f5a963a60636eda6a37314f2 WatchSource:0}: Error finding container 20455e139d1fff45b63f12abbcae38b479cf8256f5a963a60636eda6a37314f2: Status 404 returned error can't find the container with id 20455e139d1fff45b63f12abbcae38b479cf8256f5a963a60636eda6a37314f2 Sep 18 15:02:35.900266 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:35.900230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" event={"ID":"461e4e1d-02b1-4f21-9cff-de620e3bf238","Type":"ContainerStarted","Data":"2e8713b71d231e3f3320e0bdeaac5e658e30aa126d2139029669620c3d137a1f"} Sep 18 15:02:35.900266 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:35.900269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" event={"ID":"461e4e1d-02b1-4f21-9cff-de620e3bf238","Type":"ContainerStarted","Data":"20455e139d1fff45b63f12abbcae38b479cf8256f5a963a60636eda6a37314f2"} Sep 18 15:02:35.920374 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:35.920326 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" podStartSLOduration=1.740889434 podStartE2EDuration="1.920306151s" totalImagesPullingTime="179.416717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:02:35.9192183 +0000 UTC m=+681.368928073" watchObservedRunningTime="2026-09-18 15:02:35.920306151 +0000 UTC m=+681.370015922" Sep 18 15:02:38.953807 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:38.953778 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:38.954257 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:38.953855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:38.966311 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:38.966288 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:39.930470 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:39.930442 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqs9d" Sep 18 15:02:42.346820 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:42.346787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:02:44.946403 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:44.946375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:44.946845 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:44.946530 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:44.958863 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:44.958838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:02:45.961509 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:02:45.961471 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dtrsv" Sep 18 15:03:01.737258 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:03:01.737179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:03:03.137687 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:03:03.137654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:04:03.566090 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:04:03.566058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:04:03.974852 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:04:03.974823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:04:04.121453 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:04:04.121421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:16.623904 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:06:16.623878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 15:06:16.624386 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:06:16.624172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngtnw_971ee4dd-e6fe-4cc8-be2e-9b69d4b0a788/ovn-acl-logging/0.log" Sep 18 15:06:25.392091 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:06:25.392060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:06:38.972070 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:06:38.972040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:18.508455 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:18.508421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:18.587652 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:18.587624 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" limit=1024 Sep 18 15:07:21.317627 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:21.317597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qssc6_c9dea73b-2e57-4248-928a-131e3d3756f2/global-pull-secret-syncer/0.log" Sep 18 15:07:21.423319 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:21.423293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bq7xl_e88c91a9-f643-451d-92b3-80b3e055d80e/konnectivity-agent/0.log" Sep 18 15:07:21.501783 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:21.501756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-100.ec2.internal_c8eb1fd79cc17874fe2d743b98ef7b8d/haproxy/0.log" Sep 18 15:07:25.719945 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:25.719905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-6k4l8_cdf570e0-e5c4-4d07-a1c3-3f6bbe46faed/manager/0.log" Sep 18 15:07:25.863843 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:25.863807 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-cznff_d1ff1467-5052-4e91-a296-726ad17657e1/manager/0.log" Sep 18 15:07:27.489386 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.489361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/alertmanager/0.log" Sep 18 15:07:27.517818 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.517795 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/config-reloader/0.log" Sep 18 15:07:27.537593 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.537570 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/kube-rbac-proxy-web/0.log" Sep 18 15:07:27.562233 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.562207 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/kube-rbac-proxy/0.log" Sep 18 15:07:27.588947 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.588926 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/kube-rbac-proxy-metric/0.log" Sep 18 15:07:27.613088 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.613069 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/prom-label-proxy/0.log" Sep 18 15:07:27.637108 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.637089 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_15596d4b-a02b-4b6b-a47c-181bf54fc53b/init-config-reloader/0.log" Sep 18 15:07:27.712703 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.712682 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-69m5d_ace159c2-8081-4c52-8454-ac84cb1dac4f/kube-state-metrics/0.log" Sep 18 15:07:27.732132 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.732116 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-69m5d_ace159c2-8081-4c52-8454-ac84cb1dac4f/kube-rbac-proxy-main/0.log" Sep 18 15:07:27.753648 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.753627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-69m5d_ace159c2-8081-4c52-8454-ac84cb1dac4f/kube-rbac-proxy-self/0.log" Sep 18 15:07:27.794194 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.794170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55c8876dd7-jdqvn_d2fe4ec1-c083-4e19-9b5b-9040aff3ab2a/metrics-server/0.log" Sep 18 15:07:27.818817 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.818793 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-mtwrk_fd63a3a1-61ee-4647-ad52-d236c6295808/monitoring-plugin/0.log" Sep 18 15:07:27.930611 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.930589 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcgbd_85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d/node-exporter/0.log" Sep 18 15:07:27.967094 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.967027 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcgbd_85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d/kube-rbac-proxy/0.log" Sep 18 15:07:27.988100 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:27.988073 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcgbd_85c0cbc1-dc71-4edf-b4ed-9b6f49ab1e6d/init-textfile/0.log" Sep 18 15:07:28.112853 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.112813 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-cqmmq_b95b55ac-409f-494b-9558-1b518e698058/kube-rbac-proxy-main/0.log" Sep 18 15:07:28.139853 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.139819 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-cqmmq_b95b55ac-409f-494b-9558-1b518e698058/kube-rbac-proxy-self/0.log" Sep 18 15:07:28.161377 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.161345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-cqmmq_b95b55ac-409f-494b-9558-1b518e698058/openshift-state-metrics/0.log" Sep 18 15:07:28.234795 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.234713 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/prometheus/0.log" Sep 18 15:07:28.285052 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.285025 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/config-reloader/0.log" Sep 18 15:07:28.337546 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.337526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/thanos-sidecar/0.log" Sep 18 15:07:28.361594 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.361572 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/kube-rbac-proxy-web/0.log" Sep 18 15:07:28.397054 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.397035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/kube-rbac-proxy/0.log" Sep 18 15:07:28.424626 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.424602 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/kube-rbac-proxy-thanos/0.log" Sep 18 15:07:28.453922 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.453903 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a91fa0b8-9d68-42cb-bb73-3d81b24282fa/init-config-reloader/0.log" Sep 18 15:07:28.485027 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.484964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-bqpvm_e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50/prometheus-operator/0.log" Sep 18 15:07:28.511817 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.511792 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-bqpvm_e29f2e7d-3fdc-485e-a5e1-6804ef2f5f50/kube-rbac-proxy/0.log" Sep 18 15:07:28.540483 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.540449 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-kv96n_dcd54acd-bbac-4070-a1d2-446293d83cca/prometheus-operator-admission-webhook/0.log" Sep 18 15:07:28.570505 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.570462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86d6954f-rgmcb_86e60f4a-d965-42d9-9785-da5aa92c8c30/telemeter-client/0.log" Sep 18 15:07:28.591899 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.591878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86d6954f-rgmcb_86e60f4a-d965-42d9-9785-da5aa92c8c30/reload/0.log" Sep 18 15:07:28.622624 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.622600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86d6954f-rgmcb_86e60f4a-d965-42d9-9785-da5aa92c8c30/kube-rbac-proxy/0.log" Sep 18 15:07:28.657935 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.657905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b847d7cbb-zrg7h_0c319756-c3f0-4002-b7c6-1c1cf164f837/thanos-query/0.log" Sep 18 15:07:28.682093 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.682064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b847d7cbb-zrg7h_0c319756-c3f0-4002-b7c6-1c1cf164f837/kube-rbac-proxy-web/0.log" Sep 18 15:07:28.710222 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.710191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b847d7cbb-zrg7h_0c319756-c3f0-4002-b7c6-1c1cf164f837/kube-rbac-proxy/0.log" Sep 18 15:07:28.727321 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.727293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b847d7cbb-zrg7h_0c319756-c3f0-4002-b7c6-1c1cf164f837/prom-label-proxy/0.log" Sep 18 15:07:28.749472 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.749406 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b847d7cbb-zrg7h_0c319756-c3f0-4002-b7c6-1c1cf164f837/kube-rbac-proxy-rules/0.log" Sep 18 15:07:28.775616 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:28.775598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b847d7cbb-zrg7h_0c319756-c3f0-4002-b7c6-1c1cf164f837/kube-rbac-proxy-metrics/0.log" Sep 18 15:07:31.064233 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.064202 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95"] Sep 18 15:07:31.067973 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.067952 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.070423 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.070404 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fdt8r\"/\"openshift-service-ca.crt\"" Sep 18 15:07:31.071100 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.071086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fdt8r\"/\"default-dockercfg-zw8cr\"" Sep 18 15:07:31.071180 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.071119 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fdt8r\"/\"kube-root-ca.crt\"" Sep 18 15:07:31.078150 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.078126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95"] Sep 18 15:07:31.141505 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.141458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfnf\" (UniqueName: \"kubernetes.io/projected/6402f62a-6f88-47e5-bd6a-a687b892cfdb-kube-api-access-qvfnf\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.141669 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.141544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-podres\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.141669 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.141616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-proc\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.141669 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.141650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-lib-modules\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.141791 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.141680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-sys\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.242898 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.242864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfnf\" (UniqueName: \"kubernetes.io/projected/6402f62a-6f88-47e5-bd6a-a687b892cfdb-kube-api-access-qvfnf\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243045 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.242929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-podres\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243112 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-podres\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243112 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-proc\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243200 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-lib-modules\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243200 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-sys\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243306 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243197 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-proc\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243306 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-sys\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.243306 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.243270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6402f62a-6f88-47e5-bd6a-a687b892cfdb-lib-modules\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.251038 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.251016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfnf\" (UniqueName: \"kubernetes.io/projected/6402f62a-6f88-47e5-bd6a-a687b892cfdb-kube-api-access-qvfnf\") pod \"perf-node-gather-daemonset-hpt95\" (UID: \"6402f62a-6f88-47e5-bd6a-a687b892cfdb\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.314921 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.314838 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c85466689-9964l_9f773fb6-69e4-4013-88d7-1842bbd37336/console/0.log" Sep 18 15:07:31.379423 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.379398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:31.650548 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:31.650525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95"] Sep 18 15:07:31.652725 ip-10-0-131-100 kubenswrapper[2581]: W0918 15:07:31.652696 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6402f62a_6f88_47e5_bd6a_a687b892cfdb.slice/crio-be0730998dbc58378e54b868101ace4ecb3008e7bfdb1ee623126a05c52e8dfd WatchSource:0}: Error finding container be0730998dbc58378e54b868101ace4ecb3008e7bfdb1ee623126a05c52e8dfd: Status 404 returned error can't find the container with id be0730998dbc58378e54b868101ace4ecb3008e7bfdb1ee623126a05c52e8dfd Sep 18 15:07:32.406244 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:32.406202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" event={"ID":"6402f62a-6f88-47e5-bd6a-a687b892cfdb","Type":"ContainerStarted","Data":"a481e35922a64d11940c5114617819a9badd43063ce229aed56154f92a95d873"} Sep 18 15:07:32.406655 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:32.406287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" event={"ID":"6402f62a-6f88-47e5-bd6a-a687b892cfdb","Type":"ContainerStarted","Data":"be0730998dbc58378e54b868101ace4ecb3008e7bfdb1ee623126a05c52e8dfd"} Sep 18 15:07:32.406655 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:32.406337 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:32.423605 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:32.423556 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" podStartSLOduration=1.423540585 podStartE2EDuration="1.423540585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 15:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:07:32.42122069 +0000 UTC m=+977.870930464" watchObservedRunningTime="2026-09-18 15:07:32.423540585 +0000 UTC m=+977.873250356" Sep 18 15:07:33.180673 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:33.180648 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7b26p_150ca376-fd96-4c2d-8350-3d41673c8885/dns/0.log" Sep 18 15:07:33.202122 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:33.202097 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7b26p_150ca376-fd96-4c2d-8350-3d41673c8885/kube-rbac-proxy/0.log" Sep 18 15:07:33.370252 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:33.370223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5ptl_f3006540-82ff-43ae-9bc6-daf4a56af7f6/dns-node-resolver/0.log" Sep 18 15:07:33.969967 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:33.969940 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xlpc6_4450c953-5f51-4803-889a-6571a219c972/node-ca/0.log" Sep 18 15:07:34.959630 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:34.959603 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4fc4958f-bp2qf_aafb72fc-6837-4c8f-8d00-802591a2d7ee/kube-auth-proxy/0.log" Sep 18 15:07:35.601413 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:35.601380 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hgj6r_f13b930e-ba98-43ac-a9dd-daedaa617cc1/serve-healthcheck-canary/0.log" Sep 18 15:07:36.149837 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:36.149808 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8ljzp_47750d0b-6a21-4141-817e-6207bda466ec/kube-rbac-proxy/0.log" Sep 18 15:07:36.171176 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:36.171156 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8ljzp_47750d0b-6a21-4141-817e-6207bda466ec/exporter/0.log" Sep 18 15:07:36.192606 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:36.192585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8ljzp_47750d0b-6a21-4141-817e-6207bda466ec/extractor/0.log" Sep 18 15:07:38.423556 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:38.423525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hpt95" Sep 18 15:07:38.780391 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:38.780363 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn_eb91f711-40a5-4655-8997-0409a484bbe5/manager/0.log" Sep 18 15:07:38.802130 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:38.802105 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9d9f7dcc-nhhzn_eb91f711-40a5-4655-8997-0409a484bbe5/copy-manifests/0.log" Sep 18 15:07:40.086824 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:40.086796 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-859bf4c848-8dzt5_daa08df8-37c7-4b8f-9ea4-c7cc9f5ee414/manager/0.log" Sep 18 15:07:40.142022 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:40.142000 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gdqsf_155ff73a-3230-475c-a16f-ca71e194e9a1/openshift-lws-operator/0.log" Sep 18 15:07:41.543162 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:41.543135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4fc4958f-bp2qf_aafb72fc-6837-4c8f-8d00-802591a2d7ee/kube-auth-proxy/0.log" Sep 18 15:07:42.809960 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:42.809925 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c4fc4958f-bp2qf_aafb72fc-6837-4c8f-8d00-802591a2d7ee/kube-auth-proxy/0.log" Sep 18 15:07:46.694584 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.694563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/kube-multus-additional-cni-plugins/0.log" Sep 18 15:07:46.715330 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.715309 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/egress-router-binary-copy/0.log" Sep 18 15:07:46.735520 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.735468 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/cni-plugins/0.log" Sep 18 15:07:46.755904 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.755880 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/bond-cni-plugin/0.log" Sep 18 15:07:46.778227 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.778206 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/routeoverride-cni/0.log" Sep 18 15:07:46.799725 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.799702 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/whereabouts-cni-bincopy/0.log" Sep 18 15:07:46.819680 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:46.819659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nvrxj_9d14d620-e790-499c-b590-db8b3c9943e3/whereabouts-cni/0.log" Sep 18 15:07:47.252218 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:47.252193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-slp2j_566cccb0-d3b2-4c0b-8f89-4001d2012c30/kube-multus/0.log" Sep 18 15:07:47.273365 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:47.273348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g2bgv_8a182eef-39b5-4828-b477-00556fb11d14/network-metrics-daemon/0.log" Sep 18 15:07:47.292923 ip-10-0-131-100 kubenswrapper[2581]: I0918 15:07:47.292901 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g2bgv_8a182eef-39b5-4828-b477-00556fb11d14/kube-rbac-proxy/0.log"